-- Logs begin at Fri 2022-06-03 08:19:07 UTC, end at Fri 2022-06-03 09:31:23 UTC. -- Jun 03 08:49:36.186063 dv-cinder-812685-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 03 08:49:36.195120 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 08:49:36 2022] *** Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: nodename: dv-cinder-812685-8-iscsi Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: machine: x86_64 Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: clock source: unix Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: pcre jit disabled Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: detected number of CPU cores: 4 Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: current working directory: / Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: detected binary path: /usr/bin/uwsgi-core Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: your processes number limit is 47680 Jun 03 08:49:36.197356 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: your memory page size is 4096 bytes Jun 03 08:49:36.198044 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: detected max file descriptor number: 2048 Jun 03 08:49:36.198044 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: lock engine: pthread robust mutexes Jun 03 08:49:36.198044 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: thunder lock: enabled Jun 03 08:49:36.198044 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 03 08:49:36.198044 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 08:49:36.243299 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: Python main interpreter initialized at 0x5585e471d9c0 Jun 03 08:49:36.243299 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: python threads support enabled Jun 03 08:49:36.243299 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: your server socket listen backlog is limited to 100 connections Jun 03 08:49:36.243299 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: your mercy for graceful operations on workers is 90 seconds Jun 03 08:49:36.243740 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 08:49:36.243740 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: *** Operational MODE: preforking *** Jun 03 08:49:36.243996 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: *** uWSGI is running in multiple interpreter mode *** Jun 03 08:49:36.243996 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: spawned uWSGI master process (pid: 80215) Jun 03 08:49:36.244208 dv-cinder-812685-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 03 08:49:36.245522 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: spawned uWSGI worker 1 (pid: 80221, cores: 1) Jun 03 08:49:36.245522 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: spawned uWSGI worker 2 (pid: 80222, cores: 1) Jun 03 08:49:36.245522 dv-cinder-812685-8-iscsi devstack@keystone.service[80215]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 08:49:42.195777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:49:42.195777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: from cryptography.utils import int_from_bytes Jun 03 08:49:42.196566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:49:42.196566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: from cryptography.utils import int_from_bytes Jun 03 08:49:42.197003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:49:42.197003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: from cryptography.utils import int_from_bytes Jun 03 08:49:42.197146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 08:49:42.197146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: from cryptography.utils import int_from_bytes Jun 03 08:49:42.247247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 08:49:42.247402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 08:49:42.247490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 08:49:42.247589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 08:49:42.247670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] command line args: [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 08:49:42.247742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] command line args: [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 08:49:42.247851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 08:49:42.247971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 08:49:42.248051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ================================================================================ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 08:49:42.248159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ================================================================================ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 08:49:42.248240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] admin_token = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.248420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] admin_token = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.248498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] config_dir = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.248651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.248736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config_dir = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.248820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] config_source = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.248896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] debug = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config_source = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] debug = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.249945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_config_append = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_config_append = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.250989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_dir = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_dir = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251858 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.251939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.252929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.253877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.254886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] publish_errors = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] publish_errors = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.255988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] standard_threads = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.256922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] standard_threads = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] use_journal = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] use_json = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_journal = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] use_stderr = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.257927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_json = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.258032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] use_syslog = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.258109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_stderr = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.258220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_syslog = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.258296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.258453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 08:49:42.258532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.258713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.258798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.258956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.259972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.260941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.261992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.262983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.263987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.264970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.265928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.266875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.267853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.268932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.269984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.270913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.271981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.272938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.273968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.274911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.275936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.276882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.277043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.277119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.277287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.277369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.278997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.279831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.280967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.281971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.282907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.283929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.external = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.external = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.284920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.password = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.password = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.token = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.token = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.285852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.286964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.287967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.288921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.289933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.290987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.291922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.292984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.293112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.293786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.293932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.294947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.295987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.296960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.297937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.298968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.299919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.300940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.301975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.302098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.302480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.302603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.302731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.302851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.302992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.303899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304754 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.304989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.305992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.306884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.307926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.308952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.309995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.310998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.311911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.312923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.313935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.314933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.315994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.316905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.317998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.318907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.319913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] role.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] role.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.320942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.321969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.322879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.323919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.324049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.324131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.324206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.324842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.324970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.325811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.326830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.327978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.328981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.329892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.330913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.331959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.332869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.333915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.334934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.335918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.336946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 08:49:42.337604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 08:49:42.337604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 08:49:42.365401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.365546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.365624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.365727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.365828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.365953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.374634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.374879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.404691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.404884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.404972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.405047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.460148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.460323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.514312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.514490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.516133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.516378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.584928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.585888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.586020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.586101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.610452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.610638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.610784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.610872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.610950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.611927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.623835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.624179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.637527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.637715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.637801 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.637909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.637994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.638890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.639010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 08:49:42.657152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.657369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 08:49:42.657482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.657690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 08:49:42.657771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.657908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 08:49:42.658032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.658178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.658268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 08:49:42.658437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.658517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.658691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.658770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.658954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.659065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.659221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.670929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.671144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.679293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.679865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.682659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.682939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.683216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.683362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.683495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.683582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.684341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.684436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.684628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.684727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.684912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.684995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.685322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.685418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.685559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.685642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.685834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.685913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.686128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.686219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.686442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.686675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.713717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.714332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.715498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.715800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.716154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.716434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.721127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.721422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.721705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.722048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.722340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.722622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.729067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.729368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.729970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.730251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.734045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.734449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.734732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.734828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.735019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.735216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.735297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.735504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.735598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.735812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.735896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.736099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.736180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.736379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.736655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.736929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.755023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.755298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.755935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.756214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.759922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.760804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.764112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.764460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.764988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.765282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.769338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.770221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.772920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.773802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.778113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.778419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.778709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.778993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.779161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.779271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.779354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.779549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.779633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.779858 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.780137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.780414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.798499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.798790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.799059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.799378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.799470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.799674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.799969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.800246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.807611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.808497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.809898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.810184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.810764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.811042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.813259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.813545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.813825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.814101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.814185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.814377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.814461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.814656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.814935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.815236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.827834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.828115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.828395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.828674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.828955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.829038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.829232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.829315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.829518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.829605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.829802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.830084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.830359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.830636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.848221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.849263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.851467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.852682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.854802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.856568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.856994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.858176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.858649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.858929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.859208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.859837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.860128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.860412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.866626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.867834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.868268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.869454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.871509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.871842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.872133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.872414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.872770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.873062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.873346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.873623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.881543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.881836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.882224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.883342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.883630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.884052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.890285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.890569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.890853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.891132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.891405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.891690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.891991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.892206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 08:49:42.892288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.892487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.892566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.892768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.892857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893399 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.893938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.894138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.894407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.894677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.894948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.895223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.895504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.895782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 08:49:42.932720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585e471d9c0 pid: 80221 (default app) Jun 03 08:49:42.934953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585e471d9c0 pid: 80222 (default app) Jun 03 08:49:42.936116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046781-7ca3-4d2c-8963-db68d5e55f9f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:42.936412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046781-7ca3-4d2c-8963-db68d5e55f9f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:42.936691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046781-7ca3-4d2c-8963-db68d5e55f9f None None] PATH_INFO: `/v3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:42.940996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Fri Jun 3 08:49:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:49:51.023392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:51.023964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:51.023964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:51.029058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:49:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:49:51.034585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:51.035121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:51.035121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:51.104094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: INFO dbcounter [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] Registered counter for database keystone Jun 03 08:49:51.126116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG oslo_db.sqlalchemy.engines [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:49:51.132750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writer thread running {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:49:51.421062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG passlib.handlers.bcrypt [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80221) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 08:49:51.421481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG passlib.handlers.bcrypt [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80221) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 08:49:51.478014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:49:51.479666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:49:51.619549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:49:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 586 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 03 08:49:51.784230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:51.853853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: INFO dbcounter [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] Registered counter for database keystone Jun 03 08:49:51.874699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG oslo_db.sqlalchemy.engines [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 08:49:51.883992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writer thread running {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 08:49:52.116632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7348-3885-4ce3-9e0d-79829c524a9f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:52.121135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:52.122338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:52.122621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:52.122892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:52.131823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:52.184750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 08:49:52.185089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eccea-3da9-4306-be12-8134f1cfd55d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:52.195616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Jun 3 08:49:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 08:49:52.201937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:52.222780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74508a6-dad3-4d14-ae3c-4a384459c450 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:52.230943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:52.232919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:52.233416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:52.233891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] PATH_INFO: `/v3/projects/f8d8a528e88945da98e9389d0fe7141f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:52.235772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d8a528e88945da98e9389d0fe7141f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:52.305807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING keystone.common.rbac_enforcer.enforcer [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 08:49:52.306320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c6cbc-d010-4007-ba0b-dd6b39dd9c23 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:52.314337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Fri Jun 3 08:49:52 2022] GET /identity/v3/projects/f8d8a528e88945da98e9389d0fe7141f => generated 344 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:49:54.620680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed950-22ca-4189-95bc-84a2b5d67297 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:54.621229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed950-22ca-4189-95bc-84a2b5d67297 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:54.621229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed950-22ca-4189-95bc-84a2b5d67297 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:54.625372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:49:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:49:54.630800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:54.631197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:54.631362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:54.650409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:49:54.651953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:49:54.660385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:49:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 08:49:54.684509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ed950-22ca-4189-95bc-84a2b5d67297 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:54.701485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ed950-22ca-4189-95bc-84a2b5d67297 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:54.705802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c27763-ec8a-472c-b9bc-b216e771e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:54.706445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c27763-ec8a-472c-b9bc-b216e771e3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:54.706730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c27763-ec8a-472c-b9bc-b216e771e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:54.707008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c27763-ec8a-472c-b9bc-b216e771e3f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:54.714949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c27763-ec8a-472c-b9bc-b216e771e3f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:54.716802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c27763-ec8a-472c-b9bc-b216e771e3f9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:54.725688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Jun 3 08:49:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 08:49:54.731433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:54.740627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c62bf-a5ed-48f8-8450-d714ccac46ff None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:54.745073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d451-6d9a-4def-96e4-5df6d0cd6bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:54.746422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d451-6d9a-4def-96e4-5df6d0cd6bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:54.746702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d451-6d9a-4def-96e4-5df6d0cd6bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:54.746976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d451-6d9a-4def-96e4-5df6d0cd6bb0 admin admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:54.748380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d451-6d9a-4def-96e4-5df6d0cd6bb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:54.750216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d451-6d9a-4def-96e4-5df6d0cd6bb0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:54.751774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Fri Jun 3 08:49:54 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:49:57.051613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a7753-c25f-4682-9e3c-db751620a699 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.052425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a7753-c25f-4682-9e3c-db751620a699 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.052425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a7753-c25f-4682-9e3c-db751620a699 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.053797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:49:57.059488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.059939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.060082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.077370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:49:57.078558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:49:57.103721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a0d8-61d3-4277-b327-88e3cb662c0b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.104048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a0d8-61d3-4277-b327-88e3cb662c0b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.104319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a0d8-61d3-4277-b327-88e3cb662c0b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.105728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:49:57.110883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.111169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.111603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.152874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG passlib.handlers.bcrypt [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80222) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 08:49:57.153310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG passlib.handlers.bcrypt [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80222) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 08:49:57.159889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:49:57.182854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.200611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:49:57.202203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:49:57.206753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.287167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf2a7-a91a-4c00-b652-f35e0032582c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.302799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:49:57.323174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.324155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.324446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.324727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.325639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.336232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:49:57.347413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:49:57.348632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:49:57.349461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:49:57.354325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.425544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab5522-f1e4-406c-b7b8-8eb42391d625 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.428114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.437145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.455994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6a3a6-2561-4683-8e5e-fb5b87dbc498 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.464439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.465430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.465715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.465988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.490256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.490923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.491203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.491474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.492256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:49:57.492562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.493961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:57.507470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:49:57.512812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.537663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.539150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:57.611918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adb546-fef4-4d20-a552-d225b23977be None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.637969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:49:57.643486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.646280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.647096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.648225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.648567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.648900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.650175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.651657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:57.660693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:49:57.661722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.676921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.747048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94193e-3bee-45ed-a7c5-845f861f1131 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.761001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd43b9b-1c7c-478a-9c36-cd8c17a43daf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.780969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.781752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.782030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.782298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.794706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.795437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.795722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.796027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.797202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.798665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:57.800281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:49:57.802603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.804147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:57.806086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:49:57.825267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:49:57.826165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:49:57.826973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:49:57.826973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:49:57.826973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:49:57.826973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:49:57.826973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:49:57.832395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:49:57.885725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.889804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:49:57.906360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fdd6c-892e-4427-8a62-6896fb8fd946 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.938682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69401-af83-49d0-9770-753ffcefb5cd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:49:57.946001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.946708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.946989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.947265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.948130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.domain.id=default, user.id=85bd9af08cec4721bdd226bdaa9b2d35) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:49:57.948445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.949901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ece7be-5b4b-44b8-8b06-00b71953c373 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:57.956663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/role_assignments?user.id=85bd9af08cec4721bdd226bdaa9b2d35&scope.domain.id=default&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:49:57.978807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:49:57.979506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:49:57.979826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:49:57.980107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:49:57.981520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:49:57.981831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:49:57.983331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514ff9e-4efa-43e8-967c-dabd6c00fe7c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:49:58.005068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:00.493073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0efeba-a0c5-4515-8890-52a75ab8a370 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:00.493608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0efeba-a0c5-4515-8890-52a75ab8a370 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:00.493608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0efeba-a0c5-4515-8890-52a75ab8a370 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:00.495384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:00.502081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:00.502945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:00.503423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:00.522452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:00.524171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:00.619879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:00.636195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0efeba-a0c5-4515-8890-52a75ab8a370 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:00.775808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0efeba-a0c5-4515-8890-52a75ab8a370 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:00.820003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:00.821164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:00.821670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:00.822142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:00.840934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:00.849022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:00.849861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:00.850604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:00.852988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 13/24] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:00.859499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:00.911942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:00.972415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1573-c1de-4ebf-bf93-c573eae63e8f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:01.012349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:01.013047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.013334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.013615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.014401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:01.014712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:01.016315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ed25-adad-43e0-9cd7-0fdb5410c1bf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:01.030337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 12/25] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:01.036457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:01.040440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:01.187041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd53c2-c290-4fec-aa23-d6d7ed932dbb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:01.227529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88b3b9-1b12-46ef-a5bc-ead3c8389e47 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.227859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88b3b9-1b12-46ef-a5bc-ead3c8389e47 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.228123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88b3b9-1b12-46ef-a5bc-ead3c8389e47 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.229708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 13/26] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:01.234573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.234864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.235144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.254739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:01.256012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.256302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.256589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.257840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:01.259458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:01.260763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:01.261371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 14/27] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:01 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:01.262577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:01.267669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:01.385496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 14/28] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:01.412127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:01.453659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c561aa7-96b6-41dc-b476-4168a3b4ec90 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:01.458488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:01.529486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54046940-d4f2-4b94-8cc5-ab160c463ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:01.530317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54046940-d4f2-4b94-8cc5-ab160c463ccd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.530602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54046940-d4f2-4b94-8cc5-ab160c463ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.530880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54046940-d4f2-4b94-8cc5-ab160c463ccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.531891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:01.532602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54046940-d4f2-4b94-8cc5-ab160c463ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:01.534284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54046940-d4f2-4b94-8cc5-ab160c463ccd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:01.536305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 15/29] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:01.537328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613541d-a6a9-41df-baef-3dea663ca65b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.537658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613541d-a6a9-41df-baef-3dea663ca65b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.537898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613541d-a6a9-41df-baef-3dea663ca65b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.539126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:01.547106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613541d-a6a9-41df-baef-3dea663ca65b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:01.637485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d47e-4ce8-4456-bd49-bf23a5a0d880 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:01.685688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b9be-751b-43dc-96d9-5e0304a03b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:01.687097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b9be-751b-43dc-96d9-5e0304a03b53 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.687531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b9be-751b-43dc-96d9-5e0304a03b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.688007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b9be-751b-43dc-96d9-5e0304a03b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.689238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b9be-751b-43dc-96d9-5e0304a03b53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:01.690976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b9be-751b-43dc-96d9-5e0304a03b53 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:01.696796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613541d-a6a9-41df-baef-3dea663ca65b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:01.740694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc3bb8-ac92-488b-a3cd-85c80b4252e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:01.741915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc3bb8-ac92-488b-a3cd-85c80b4252e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.742342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc3bb8-ac92-488b-a3cd-85c80b4252e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.742819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc3bb8-ac92-488b-a3cd-85c80b4252e6 None admin] PATH_INFO: `/v3/domains/default/users/85bd9af08cec4721bdd226bdaa9b2d35/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.745153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc3bb8-ac92-488b-a3cd-85c80b4252e6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=85bd9af08cec4721bdd226bdaa9b2d35, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:01.747374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc3bb8-ac92-488b-a3cd-85c80b4252e6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:01.763666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:01.825753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 15/31] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 08:50:01 2022] POST /identity/v3/roles => generated 225 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:50:01.827339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.827638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.836220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.870309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:01.872485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:01.882711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 17/32] 10.222.0.61 () {58 vars in 1361 bytes} [Fri Jun 3 08:50:01 2022] PUT /identity/v3/domains/default/users/85bd9af08cec4721bdd226bdaa9b2d35/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:01.885141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845dbe-36aa-4fee-87e3-b096bfb7af4a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.885676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845dbe-36aa-4fee-87e3-b096bfb7af4a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.886106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845dbe-36aa-4fee-87e3-b096bfb7af4a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.892163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 18/33] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:01.898695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:01.899681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:01.900245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:01.921928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:01.923910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:02.006627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 16/34] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:02.009863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:02.037931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.044890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.112682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:02.239065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b2157-875c-4d4a-978c-3ce0b0720b89 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:02.241134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a9521-26b1-4df8-b14c-846349eb7dc1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:02.276029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:02.281996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c6421-fe00-47b0-a195-88a829d903ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:02.283865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6421-fe00-47b0-a195-88a829d903ce None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.283865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6421-fe00-47b0-a195-88a829d903ce None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.283865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6421-fe00-47b0-a195-88a829d903ce None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.284121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c6421-fe00-47b0-a195-88a829d903ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:02.285559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c6421-fe00-47b0-a195-88a829d903ce None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:02.287354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:02.290848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.290848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.290848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.304417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 20/36] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 08:50:02 2022] POST /identity/v3/roles => generated 219 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:02.305547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea94ae-2ac5-4b60-937b-af7a4a95c51b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.305651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:02.305852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea94ae-2ac5-4b60-937b-af7a4a95c51b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.306148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea94ae-2ac5-4b60-937b-af7a4a95c51b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.307231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:02.309926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 21/37] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:02.312277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f17a17-3c70-46b4-b958-484e788f1e79 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.312866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f17a17-3c70-46b4-b958-484e788f1e79 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.313370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f17a17-3c70-46b4-b958-484e788f1e79 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.315135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 22/38] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:02.321040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.322492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.323178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ca943e8d-a527-4ea9-adc2-3be608f9fbb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:50:02.333744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:02.334621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:02.335646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:50:02.335646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:50:02.335646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:50:02.335646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:02.335646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 17/39] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:02.337103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.337502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.337899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.349319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:02.350880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:02.358079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:02.359481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:02.445316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 18/40] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:02.450918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.451822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 23/41] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:02.475340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.516235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:02.601225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a94aa-7784-44e4-ae1b-a2151e0d60b7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:02.614059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd01d34-3662-4fad-a480-a34b0486cc23 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:02.639656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:02.640178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.640468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.640748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.641002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:02.641484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:02.641802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:02.643714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:02.662621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 19/42] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:02.663161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:02.663973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.664871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.665369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.665864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.669002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:02.671484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:02.673764 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 24/43] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:02.675054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.757745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:02.793511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3709d-777c-49be-a1fc-f543e1b4259b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:02.800243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c4ac5-61b2-4206-a08c-3d82a74cba88 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:02.831338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:02.832056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.832348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.832622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.833377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:02.834780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:02.836215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb70ce3-40cf-48fc-835c-77e6f7715eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:02.836896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70ce3-40cf-48fc-835c-77e6f7715eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:02.837183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70ce3-40cf-48fc-835c-77e6f7715eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:02.837466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70ce3-40cf-48fc-835c-77e6f7715eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:02.838185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb70ce3-40cf-48fc-835c-77e6f7715eb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:02.840026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb70ce3-40cf-48fc-835c-77e6f7715eb7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:02.855949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 20/44] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 08:50:02 2022] POST /identity/v3/roles => generated 223 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:02.857163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:02.888229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 25/45] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:50:02 2022] POST /identity/v3/projects => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:02.998120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee390a-a6cd-4979-ab22-7abee665cf78 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:03.034441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:03.041459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b193c-081f-4f08-8405-f79d7bffdb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:03.042159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b193c-081f-4f08-8405-f79d7bffdb17 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:03.042445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b193c-081f-4f08-8405-f79d7bffdb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:03.042764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b193c-081f-4f08-8405-f79d7bffdb17 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:03.043885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b193c-081f-4f08-8405-f79d7bffdb17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:03.045478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b193c-081f-4f08-8405-f79d7bffdb17 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:03.080655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 21/46] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:50:02 2022] POST /identity/v3/projects => generated 312 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:04.352706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae87e3-9a4b-4cc0-83f3-9b9dcf844045 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:04.353253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae87e3-9a4b-4cc0-83f3-9b9dcf844045 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:04.353253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae87e3-9a4b-4cc0-83f3-9b9dcf844045 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:04.354644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 26/47] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:04.360461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:04.360871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:04.361050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:04.381468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:04.382683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:04.449366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 22/48] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:04.472469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae87e3-9a4b-4cc0-83f3-9b9dcf844045 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:04.515073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:04.575850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae87e3-9a4b-4cc0-83f3-9b9dcf844045 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:04.609588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:04.610326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:04.610613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:04.610902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:04.621081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:04.628651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:04.629475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:04.630232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 27/49] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:04.635728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:04.733279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e5386-963a-4364-8d0a-cdbe18df579e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:04.746381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:04.768585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:04.769250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:04.769532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:04.769804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:04.770547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:04.770852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:04.772283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:04.781068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 23/50] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:04.786505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:04.881944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:04.885130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056db7-a8cc-4dae-970f-9a436aef71d0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:04.920503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:04.921391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:04.921675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:04.921952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:04.923167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:04.924724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:04.926373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 28/51] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:04 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:04.932730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:05.044271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a3ec2-240e-4b95-945b-0f581da09880 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:05.077751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76bea8-bcca-45b3-8452-536cab8da4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:05.078547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bea8-bcca-45b3-8452-536cab8da4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:05.078829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bea8-bcca-45b3-8452-536cab8da4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:05.079102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bea8-bcca-45b3-8452-536cab8da4a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:05.080304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76bea8-bcca-45b3-8452-536cab8da4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:05.081761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76bea8-bcca-45b3-8452-536cab8da4a1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:05.083481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 24/52] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:05.089181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:05.188346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407988df-bfda-486e-9f1a-b8a8bae714f0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:05.222613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:05.223271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:05.223560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:05.223876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:05.224716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.domain.id=default, user.id=85bd9af08cec4721bdd226bdaa9b2d35) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:05.225034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:05.226498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da966-1cb2-4ada-88fe-97c14ca7fd93 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:05.232362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 29/53] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Jun 3 08:50:05 2022] GET /identity/v3/role_assignments?user.id=85bd9af08cec4721bdd226bdaa9b2d35&scope.domain.id=default&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:05.353000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e9b29-39e1-4713-8aea-61248e2637d8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:05.353294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e9b29-39e1-4713-8aea-61248e2637d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:05.353547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e9b29-39e1-4713-8aea-61248e2637d8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:05.355066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 25/54] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:05.361392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:05.361906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:05.362022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:05.380328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:05.381583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:05.410608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:05.455104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 30/55] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:05.478112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e9b29-39e1-4713-8aea-61248e2637d8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:05.525060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:05.582753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e9b29-39e1-4713-8aea-61248e2637d8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:05.616899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96ad4c-a9dc-4d77-8270-83876ca59294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:05.617697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ad4c-a9dc-4d77-8270-83876ca59294 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:05.617986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ad4c-a9dc-4d77-8270-83876ca59294 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:05.618267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ad4c-a9dc-4d77-8270-83876ca59294 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:05.619451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96ad4c-a9dc-4d77-8270-83876ca59294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:05.621517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96ad4c-a9dc-4d77-8270-83876ca59294 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:05.623143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 26/56] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:05.628906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:05.734262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1710d7-1813-4ad9-b078-c38afb57c6d1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:05.767603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8796-8d79-415c-b0fa-c56663394f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:05.768290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8796-8d79-415c-b0fa-c56663394f78 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:05.768578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8796-8d79-415c-b0fa-c56663394f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:05.768853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8796-8d79-415c-b0fa-c56663394f78 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:05.769565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8796-8d79-415c-b0fa-c56663394f78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:05.771023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8796-8d79-415c-b0fa-c56663394f78 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:05.794912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 31/57] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Jun 3 08:50:05 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:08.070073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6fd4-25f4-4a2a-b155-598305e18f9b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:08.070642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6fd4-25f4-4a2a-b155-598305e18f9b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:08.070642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6fd4-25f4-4a2a-b155-598305e18f9b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:08.072018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 27/58] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:08.078706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:08.079131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:08.079412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:08.102742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:08.103967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:08.113999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:08.173517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 32/59] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:08.198647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6fd4-25f4-4a2a-b155-598305e18f9b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:08.298804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6fd4-25f4-4a2a-b155-598305e18f9b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:08.309789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:08.334035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea38fe-851f-4cfc-a3c5-3d7a9db3bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:08.334827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea38fe-851f-4cfc-a3c5-3d7a9db3bc76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:08.335110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea38fe-851f-4cfc-a3c5-3d7a9db3bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:08.335386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea38fe-851f-4cfc-a3c5-3d7a9db3bc76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:08.336591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea38fe-851f-4cfc-a3c5-3d7a9db3bc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:08.338059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea38fe-851f-4cfc-a3c5-3d7a9db3bc76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:08.339704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 28/60] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:08.345377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:08.444803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002d09-cd56-44fb-928f-0153b7a5226f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:08.477276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dab83-51c3-40ed-be99-362985efa7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:08.477945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dab83-51c3-40ed-be99-362985efa7d6 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:08.478233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dab83-51c3-40ed-be99-362985efa7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:08.478512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dab83-51c3-40ed-be99-362985efa7d6 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:08.479228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dab83-51c3-40ed-be99-362985efa7d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:08.481395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dab83-51c3-40ed-be99-362985efa7d6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:08.501856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:08.506845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 33/61] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:08 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:50:11.836490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc156-22e0-4eb6-ada7-c73f0958ca81 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:11.837570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc156-22e0-4eb6-ada7-c73f0958ca81 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:11.838113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc156-22e0-4eb6-ada7-c73f0958ca81 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:11.839879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 29/62] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:11.845999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:11.846502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:11.846574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:11.873009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:11.874262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:11.976936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 34/63] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:12.017418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc156-22e0-4eb6-ada7-c73f0958ca81 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.161799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc156-22e0-4eb6-ada7-c73f0958ca81 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:12.209124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cc5c7-97d9-4601-b042-b9c3e5c848e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:12.209961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc5c7-97d9-4601-b042-b9c3e5c848e2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.210251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc5c7-97d9-4601-b042-b9c3e5c848e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.210533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc5c7-97d9-4601-b042-b9c3e5c848e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.232026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cc5c7-97d9-4601-b042-b9c3e5c848e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-848cc5c7-97d9-4601-b042-b9c3e5c848e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:12.241283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:12.242271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:12.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 30/64] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:12.249007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.272269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6b4c7-1059-4bbb-860a-9c83f44acf23 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.272573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6b4c7-1059-4bbb-860a-9c83f44acf23 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.273046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6b4c7-1059-4bbb-860a-9c83f44acf23 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.274574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 31/65] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:12.281072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008663d8-2d82-4b3d-9b9b-8f3e64771d9d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.281590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008663d8-2d82-4b3d-9b9b-8f3e64771d9d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.282016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008663d8-2d82-4b3d-9b9b-8f3e64771d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.307936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-008663d8-2d82-4b3d-9b9b-8f3e64771d9d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:12.309496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-008663d8-2d82-4b3d-9b9b-8f3e64771d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:12.349002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:12.389773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8debe75-2ba3-4b09-bd64-b577ae9995e9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:12.405606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 32/66] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:12.407213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564166-9edc-4448-9dc9-88e69a38de67 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.407496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564166-9edc-4448-9dc9-88e69a38de67 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.407833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564166-9edc-4448-9dc9-88e69a38de67 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.409087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 33/67] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:12.410159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54207cd-eb6d-4e80-8946-9e3ff5f60be0 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.410445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54207cd-eb6d-4e80-8946-9e3ff5f60be0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.410720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54207cd-eb6d-4e80-8946-9e3ff5f60be0 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.418104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 34/68] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:12.418104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.418104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.418578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.444453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:12.445075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:12.446383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:12.454281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:12.455053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.455479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.455955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.457208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:12.457720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:12.459644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2808c-99cf-4931-95d6-773e97bbe25e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:12.474348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 35/69] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:12.476646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.477073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.477500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.499873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:12.501087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:12.534190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 35/70] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:12.534706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.586865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 36/71] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:12.587731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.647782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:12.647960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89e3fa-5695-4d3a-95c5-a36a57d7e218 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:12.684683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:12.685421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.685707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.685991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.692501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85002e-60e6-41fa-b9c9-038237099525 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:12.697857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:12.706698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:12.707849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:12.708622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 36/72] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:12.709237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.720913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:12.733214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acba65-5c67-4c75-9213-bb735e4bab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:12.734110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acba65-5c67-4c75-9213-bb735e4bab52 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.734403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acba65-5c67-4c75-9213-bb735e4bab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.734677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acba65-5c67-4c75-9213-bb735e4bab52 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.748896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acba65-5c67-4c75-9213-bb735e4bab52 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:12.750278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acba65-5c67-4c75-9213-bb735e4bab52 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:12.752023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 37/73] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:12.753323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd582f-a473-4d72-b37d-8f0dcbb53d60 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.753619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd582f-a473-4d72-b37d-8f0dcbb53d60 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.753900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd582f-a473-4d72-b37d-8f0dcbb53d60 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.755154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 38/74] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:12.755946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd582f-a473-4d72-b37d-8f0dcbb53d60 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.813614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ddf51-234c-4f01-b515-906636b938e7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:12.848056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:12.848873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.849160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.849444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.856609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd582f-a473-4d72-b37d-8f0dcbb53d60 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:12.859866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:12.867890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:12.868761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:12.869510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:12.870118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.891879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:12.892255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:12.892690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:12.892981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:12.893291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:12.894607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:12.896124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:12.898701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:12.898701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:12.951857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:12.975905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f7bb-eeb5-4541-8cfc-067f14bb970f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.006534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdfdf9-c560-4479-adb5-bab00ab6d3a5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.013575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.014261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.014552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.014833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.015587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:13.015941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.017360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bbb41-e089-4801-b111-e7785ecc64ad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.025572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 38/77] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:13.026818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.027110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.027394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.041457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.042114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.042921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.043203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.044736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:13.045947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:13.111118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.111789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 39/78] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:13.115967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.116062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.126427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.172491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.215607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c217-1bf4-4b26-a4a6-aa1a8def8d3f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.223607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 40/79] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:13.224449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.250191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.250873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.251164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.251450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.252242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:13.252557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.253950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.262062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 40/80] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:13.262899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.325999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cab40-6f6b-476c-9e78-79c55e469935 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.333606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.358775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.359443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.359727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.360028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.360730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.362194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.363949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf0976-21c4-4d84-ab0a-8642afd6a088 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.382515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 41/81] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:13 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:13.383407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.392943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.409842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.411052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.411339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.411805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.413843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.415359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.423463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 41/82] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:13.423463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.512047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bb653-2928-4882-9122-0beb63f2d592 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.543910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc39a39-5b5a-4bb7-ac3e-490085576dbe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.549211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.550037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.550328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.550607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.563223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:13.571145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:13.572156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:13.572905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 42/83] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:13.574829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.591299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.592626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.592626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.592819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.595060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.596582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.599233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 42/84] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:13.599233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.612282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.647112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.694650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef0eba-4967-4318-9f3d-5f2f8e5145f4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.729247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554aaff-42ba-4224-b568-6d4a090e6b90 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.746766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.747670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.747992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.748279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.749530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.751023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.752729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 43/85] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:13.753516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.782600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.782600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.782600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.782600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.860147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.861878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.875046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2dbad-2308-464c-9688-fc72d27bb4c6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:13.876058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.918358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:13.919049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:13.919346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:13.919629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:13.920496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:13.920814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:13.921271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:13.923723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:13.936838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 44/86] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:13.937698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:13.998459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 43/87] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:13.999164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.070555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70460-3088-4946-8d00-a4d1f36a77d9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:14.108812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6789e19-7aa2-473d-9497-7afd96d98ca7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:14.109652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:14.110669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:14.111201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:14.111635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:14.112641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=75faa1ace44b41f89a9a5c74487a0819) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:14.113104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:14.114746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:14.118652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:14.123415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 45/88] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/role_assignments?user.id=75faa1ace44b41f89a9a5c74487a0819&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=2dc775396d5544848b5553a1e7bf708b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:14.124796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.149043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:14.149719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:14.150009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:14.150284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:14.197521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:14.226123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:14.227628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:14.262959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62458e-908a-4c8d-8219-4e9b8ba2ae47 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:14.310665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:14.312025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:14.312632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:14.313134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:14.314853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:14.316814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:14.318802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 46/89] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:14 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:14.320011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.348457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 44/90] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:14.349254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.373859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:14.464511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183261e5-a37d-49e8-a7f0-f2cc864cd0d3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:14.496302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:14.512827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:14.513707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:14.513991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:14.514267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:14.516651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576a432-8e5e-44f6-9425-13888907acdf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:14.518922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:14.520441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:14.522175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 47/91] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:14 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:14.522943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.583559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:14.584598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:14.585084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:14.585577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:14.697285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd921-4e96-4568-b24c-2472e304eefa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:14.701191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:14.703305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:14.716115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:14.787710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:14.790852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:14.791149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:14.791454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:14.793572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:14.795269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:14.797563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 48/92] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:14 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:14.798583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.831710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 45/93] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:14.832451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:14.929286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:14.977888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136000f-6be9-4d14-aa29-81e9b30c7fc9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:15.006792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdb19f-b8ba-42c6-8b4a-1f0ce9396f81 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:15.025297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:15.060031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:15.060858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:15.061252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:15.061635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:15.062579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=85bd9af08cec4721bdd226bdaa9b2d35) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:15.063000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:15.064813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:15.065362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:15.066035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:15.066327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:15.066609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:15.067578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] RBAC: Adding query filter params (role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=75faa1ace44b41f89a9a5c74487a0819) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:15.067927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:15.069517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:15.071645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 49/94] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:14 2022] GET /identity/v3/role_assignments?user.id=85bd9af08cec4721bdd226bdaa9b2d35&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:15.076561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:15.086673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 46/95] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:14 2022] GET /identity/v3/role_assignments?user.id=75faa1ace44b41f89a9a5c74487a0819&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:15.218247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c38c9-fb09-4c29-8654-2904009d7f3d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:15.246858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:15.258308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698d49a-fb4b-4b4d-b6a2-6088d754e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:15.259215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d49a-fb4b-4b4d-b6a2-6088d754e0ba None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:15.259505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d49a-fb4b-4b4d-b6a2-6088d754e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:15.259811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d49a-fb4b-4b4d-b6a2-6088d754e0ba None admin] PATH_INFO: `/v3/projects/0c57b085ddc74ec487926663a37f6651` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:15.261251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698d49a-fb4b-4b4d-b6a2-6088d754e0ba None admin] RBAC: Authorizing `identity:get_project(project_id=0c57b085ddc74ec487926663a37f6651)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:15.263446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698d49a-fb4b-4b4d-b6a2-6088d754e0ba None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:15.265677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 50/96] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:15 2022] GET /identity/v3/projects/0c57b085ddc74ec487926663a37f6651 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:15.271428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:15.425612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f727-5c4f-4381-9210-afbc4aaa071e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:15.467859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:15.468890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:15.469400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:15.469878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:15.470918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=0c57b085ddc74ec487926663a37f6651, user.id=75faa1ace44b41f89a9a5c74487a0819) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:15.471471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:15.473221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebb0c-56be-4cab-8d0b-2b05e2f71b61 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:15.487320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 47/97] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:15 2022] GET /identity/v3/role_assignments?user.id=75faa1ace44b41f89a9a5c74487a0819&scope.project.id=0c57b085ddc74ec487926663a37f6651&role.id=2dc775396d5544848b5553a1e7bf708b => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:16.313268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252341a-ddb8-4e92-9c4a-01dbf2dccc99 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.313809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252341a-ddb8-4e92-9c4a-01dbf2dccc99 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.313809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252341a-ddb8-4e92-9c4a-01dbf2dccc99 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.315218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 51/98] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:16.320720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.321153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.321258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.339843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:16.341062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:16.375664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:16.398387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebac5f3-d90b-4f16-9490-b3a918d5a0d8 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.399006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebac5f3-d90b-4f16-9490-b3a918d5a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.399514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebac5f3-d90b-4f16-9490-b3a918d5a0d8 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.401216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 52/99] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:16.407359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.407943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.408464 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.426293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:16.428247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:16.434854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 48/100] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:16.472825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:16.501671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 53/101] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:16.527509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:16.634754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336b6e-3f4a-47cd-b62f-5c633081fba0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:16.670216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:16.674361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:16.675484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.676053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.676531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.689336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:16.697580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:16.698545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:16.699843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:16.702371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 54/102] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:16.716279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:16.746557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39b694-7dfb-46a1-9f7f-3cc84588a9fc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:16.847779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:16.847779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.847779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.847779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.849099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:16.850584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:16.852366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 49/103] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:16.868738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:16.885089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d462-a97d-4dd4-a654-e2abd3514b25 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:16.945934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:16.947060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:16.947571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:16.948163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:16.949268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:16.949783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:16.951407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:16.962586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:16.967212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 55/104] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:16.972992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:17.096109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:17.098146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d040f6-d022-4042-9f33-1101c9addef8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:17.145755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:17.146467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:17.146764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:17.147050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:17.147789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:17.149292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:17.199416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408227-95de-455a-be62-15d56fa8ddcf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:17.205682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 50/105] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:50:16 2022] POST /identity/v3/projects => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:17.253635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:17.254567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:17.254855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:17.255137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] PATH_INFO: `/v3/users/e3a130eff1fb4a6fbe13e5b62045c85f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:17.272111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a130eff1fb4a6fbe13e5b62045c85f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:17.273617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:17.275729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 56/106] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:16 2022] GET /identity/v3/users/e3a130eff1fb4a6fbe13e5b62045c85f => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:17.282505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:17.404293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:17.419482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdbe28-4d06-43fc-a06a-174902dad604 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:17.471896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:17.472591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:17.472927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:17.473213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:17.564266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:17.565779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:17.662269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:17.678861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 51/107] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:17.685319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:17.790997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d41a5a-d63f-4910-a2e1-b3a2d804a968 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:17.794037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:17.827783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c757f9f-c61b-4664-9eee-ee6b6f9f241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:17.828666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757f9f-c61b-4664-9eee-ee6b6f9f241b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:17.828950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757f9f-c61b-4664-9eee-ee6b6f9f241b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:17.829232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757f9f-c61b-4664-9eee-ee6b6f9f241b None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:17.830431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c757f9f-c61b-4664-9eee-ee6b6f9f241b None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:17.831933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c757f9f-c61b-4664-9eee-ee6b6f9f241b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:17.833642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 57/108] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:17 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:17.839592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:17.852120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129350-8864-4df8-a189-cfb9ce0f3061 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:17.852422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129350-8864-4df8-a189-cfb9ce0f3061 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:17.852684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129350-8864-4df8-a189-cfb9ce0f3061 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:17.859003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 58/109] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:17.860263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:17.860557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:17.860837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:17.896443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:17.897655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:18.048464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4cb5d-7942-4725-9753-6983b7c04ae2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:18.073557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 59/110] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:18.085073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:18.085749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.086035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.086308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.087254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] RBAC: Adding query filter params (role.id=87acdb843de948ef942863f1665147cb, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=e3a130eff1fb4a6fbe13e5b62045c85f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:18.087577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:18.089703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:18.096139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 52/111] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:17 2022] GET /identity/v3/role_assignments?user.id=e3a130eff1fb4a6fbe13e5b62045c85f&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=87acdb843de948ef942863f1665147cb => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:18.118972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:18.264495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a6cb-12f2-44b1-bef2-6dec5365fff0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:18.266050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:18.307320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:18.308277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.308567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.308846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.321220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:18.329627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:18.330541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:18.331320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 60/112] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:18.338016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:18.404175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:18.464106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc9ad-abd8-44d9-9b22-5e9bb0dca110 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:18.506012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:18.506716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.507000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.507277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.508072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:18.508383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:18.509792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:18.519695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 53/113] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:18.526183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:18.655182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085af8bf-307f-4eeb-ae9a-3b2ec33a10af None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:18.699830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4eb96-635a-434b-a296-a9488a3ed63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:18.700741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4eb96-635a-434b-a296-a9488a3ed63d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.701029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4eb96-635a-434b-a296-a9488a3ed63d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.701309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4eb96-635a-434b-a296-a9488a3ed63d None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.702548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4eb96-635a-434b-a296-a9488a3ed63d None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:18.704062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4eb96-635a-434b-a296-a9488a3ed63d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:18.705714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 61/114] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:18 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:18.711383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:18.721403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb2c98-177a-407a-9a36-303a44888b39 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.721748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb2c98-177a-407a-9a36-303a44888b39 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.721970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb2c98-177a-407a-9a36-303a44888b39 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.723719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 62/115] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:18.729332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be9438-18c3-4ad1-8066-3c96f343d6ba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.729630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be9438-18c3-4ad1-8066-3c96f343d6ba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.729956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be9438-18c3-4ad1-8066-3c96f343d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.761551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-17be9438-18c3-4ad1-8066-3c96f343d6ba None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:18.762886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-17be9438-18c3-4ad1-8066-3c96f343d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:18.827553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20877f-15c8-434e-9ff9-55ba013ee64d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:18.832108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:18.842710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:18.864517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504191e-9df6-4b0f-ab22-b92b5ba13cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:18.865400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504191e-9df6-4b0f-ab22-b92b5ba13cda None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.865686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504191e-9df6-4b0f-ab22-b92b5ba13cda None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.865963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504191e-9df6-4b0f-ab22-b92b5ba13cda None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.871185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504191e-9df6-4b0f-ab22-b92b5ba13cda None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:18.872700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504191e-9df6-4b0f-ab22-b92b5ba13cda None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:18.874435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 54/116] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:18 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:18.875658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdd46-5a2b-4cbc-b18d-f1bb7e6c5356 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.875971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdd46-5a2b-4cbc-b18d-f1bb7e6c5356 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.876254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdd46-5a2b-4cbc-b18d-f1bb7e6c5356 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.877499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 55/117] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:18.889328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdd46-5a2b-4cbc-b18d-f1bb7e6c5356 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:18.942359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 63/118] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:18.944585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:18.944890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:18.945177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:18.969725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:18.971076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:19.044903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdd46-5a2b-4cbc-b18d-f1bb7e6c5356 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.068286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 64/119] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:19.069879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.081063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95276d47-fe26-42e7-9e92-151a23b132db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.081901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95276d47-fe26-42e7-9e92-151a23b132db None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.082183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95276d47-fe26-42e7-9e92-151a23b132db None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.082458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95276d47-fe26-42e7-9e92-151a23b132db None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91/users/75faa1ace44b41f89a9a5c74487a0819/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.084700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95276d47-fe26-42e7-9e92-151a23b132db None admin] RBAC: Authorizing `identity:create_grant(project_id=e304ec690b354614bc483c8980edbb91, user_id=75faa1ace44b41f89a9a5c74487a0819, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:19.086281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95276d47-fe26-42e7-9e92-151a23b132db None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:19.109455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 56/120] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:18 2022] PUT /identity/v3/projects/e304ec690b354614bc483c8980edbb91/users/75faa1ace44b41f89a9a5c74487a0819/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:19.111170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a534-97d0-49d6-94fc-35b45f15c367 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.111467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a534-97d0-49d6-94fc-35b45f15c367 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.111746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a534-97d0-49d6-94fc-35b45f15c367 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.117660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 57/121] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:19.119189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6a534-97d0-49d6-94fc-35b45f15c367 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.178391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:19.189722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7bd57-9a80-41b0-972e-71710eca7092 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.200195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:19.229915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43837b-77a4-4864-93d6-427e7ce87558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.231080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43837b-77a4-4864-93d6-427e7ce87558 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.231579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43837b-77a4-4864-93d6-427e7ce87558 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.232068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43837b-77a4-4864-93d6-427e7ce87558 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.244553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43837b-77a4-4864-93d6-427e7ce87558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fc43837b-77a4-4864-93d6-427e7ce87558 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:19.256121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:19.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:19.257805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:19.262294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 65/122] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:19.264906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.266077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.266687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.272275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6a534-97d0-49d6-94fc-35b45f15c367 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.302934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:19.304662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:19.380749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.381561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.381889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.382277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.394393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 66/123] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:19.395481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.396876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:19.405575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:19.406627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:19.407584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:19.411595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 58/124] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:19.412848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.492126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:19.514211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4f6c8-ec35-4e9f-b999-32ddcb5428c2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.524618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:19.527734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5839206-d7cb-4241-be01-643024b5abbf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.552253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.553085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.553404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.553685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.554441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:19.554750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:19.556189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:19.565172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.565336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 67/125] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:19.566108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.566220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.566539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.566830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.567675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:19.568014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:19.569434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:19.579370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 59/126] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:19.583894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.690343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db2134-2ae9-4f8e-a344-5f2629ff2b6e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.726736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.731786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.731786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.731786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.731786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:19.731786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:19.732976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 60/127] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:19.733861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.767569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:19.772415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68680-e903-489b-9643-883d62e9d53d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.852399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.853599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.854087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.854577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.875369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:19.887473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:19.888521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:19.889283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:19.891793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 68/128] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:19.895195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:19.904086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:19.906069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2ff8-0736-4d9a-b3b8-c2ba28afdaf0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:19.990794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:19.990794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:19.990794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:19.990794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:19.991645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:19.993883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:19.996149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 61/129] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:19.996932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:20.071589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1cc4e-e7f6-48e8-b306-55ef3dfda340 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.136019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.137136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.137601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.138018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.141011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.142631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.144572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 69/130] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:20.146883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:20.182451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:20.187509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117802-b017-4419-b5cc-c5bfd9d8df68 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.250689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.251293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.251579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.251884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.252649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:20.252960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.254378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.270862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 62/131] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:20.271721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:20.280120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:20.316121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111919-a939-4c94-82b0-e6f64a3c5a72 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.352596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.353832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.354398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.355501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.356966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.358756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.360790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 70/132] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:20 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:20.361789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:20.476489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855792-8e7b-4978-a5ac-a34d4b95a758 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.512477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.513772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.514258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.516247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.517936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.519806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 71/133] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:20 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:20.520764 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:20.532148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:20.590299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefa76-18fa-46e0-9eea-8fb3164fa17a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.630282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940cb9-fee1-4933-bf0e-26a4219f52bc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.668840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.670223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.670736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.671225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91/users/85bd9af08cec4721bdd226bdaa9b2d35/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.673866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] RBAC: Authorizing `identity:create_grant(project_id=e304ec690b354614bc483c8980edbb91, user_id=85bd9af08cec4721bdd226bdaa9b2d35, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.675718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.692733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 72/134] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:20 2022] PUT /identity/v3/projects/e304ec690b354614bc483c8980edbb91/users/85bd9af08cec4721bdd226bdaa9b2d35/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:20.694215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:20.708595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8202a-3c3c-41a7-8797-0c2ddbe5cfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.709573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8202a-3c3c-41a7-8797-0c2ddbe5cfb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.709852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8202a-3c3c-41a7-8797-0c2ddbe5cfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.710649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8202a-3c3c-41a7-8797-0c2ddbe5cfb9 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91/users/75faa1ace44b41f89a9a5c74487a0819/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.717441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8202a-3c3c-41a7-8797-0c2ddbe5cfb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e304ec690b354614bc483c8980edbb91, user_id=75faa1ace44b41f89a9a5c74487a0819, role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.718972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8202a-3c3c-41a7-8797-0c2ddbe5cfb9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.750461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 63/135] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:20 2022] PUT /identity/v3/projects/e304ec690b354614bc483c8980edbb91/users/75faa1ace44b41f89a9a5c74487a0819/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:20.805262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:20.849123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59783d8-db24-4307-a1c3-f2d8d18bcdfa None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.849786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59783d8-db24-4307-a1c3-f2d8d18bcdfa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.850287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59783d8-db24-4307-a1c3-f2d8d18bcdfa None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.852088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 64/136] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:20.858457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb6a91-040c-47f0-aea9-8f02a45ce2b5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.858996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb6a91-040c-47f0-aea9-8f02a45ce2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.859489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb6a91-040c-47f0-aea9-8f02a45ce2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.859729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c1f9e-2b96-4804-b170-215036590dea None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:20.878465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4abb6a91-040c-47f0-aea9-8f02a45ce2b5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:20.880065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4abb6a91-040c-47f0-aea9-8f02a45ce2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:20.915876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:20.938033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:20.939205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:20.939633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:20.940091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] PATH_INFO: `/v3/projects/0c57b085ddc74ec487926663a37f6651` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:20.943831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0c57b085ddc74ec487926663a37f6651)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:20.945738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:20.947857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 73/137] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:20 2022] GET /identity/v3/projects/0c57b085ddc74ec487926663a37f6651 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:20.955079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:21.028842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 65/138] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:21.071853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215fb9-8193-4968-835a-b75fa47f03c3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.072165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215fb9-8193-4968-835a-b75fa47f03c3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.072419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215fb9-8193-4968-835a-b75fa47f03c3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.074520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 66/139] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:21.079643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215fb9-8193-4968-835a-b75fa47f03c3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:21.081309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a00f-1851-4092-900a-a1c2af9464f5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:21.121674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab2ad9-f9fa-4290-9288-870fd413c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:21.123022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab2ad9-f9fa-4290-9288-870fd413c8cf None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.123564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab2ad9-f9fa-4290-9288-870fd413c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.124091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab2ad9-f9fa-4290-9288-870fd413c8cf None admin] PATH_INFO: `/v3/projects/0c57b085ddc74ec487926663a37f6651/users/75faa1ace44b41f89a9a5c74487a0819/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.126625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab2ad9-f9fa-4290-9288-870fd413c8cf None admin] RBAC: Authorizing `identity:create_grant(project_id=0c57b085ddc74ec487926663a37f6651, user_id=75faa1ace44b41f89a9a5c74487a0819, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:21.128471 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab2ad9-f9fa-4290-9288-870fd413c8cf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:21.134562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:21.163468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 74/140] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:20 2022] PUT /identity/v3/projects/0c57b085ddc74ec487926663a37f6651/users/75faa1ace44b41f89a9a5c74487a0819/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 08:50:21.167769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.168355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.168639 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.196079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:21.197614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:21.277865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215fb9-8193-4968-835a-b75fa47f03c3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:21.317459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:21.318290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.318572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.318842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.320107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:21.321602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:21.324425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 67/141] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:21.325176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 75/142] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:21.329939 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:21.351448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:21.359076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:21.495502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e501-5bd0-4cd7-beca-5b46c3ee9319 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:21.528155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:21.543888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:21.544722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.545010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.545291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.558311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:21.566553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:21.567443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:21.568323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 76/143] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:21.574144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:21.574828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce782-ad82-44ef-af37-63e8c4ea6ecd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:21.652111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:21.652741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.652985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.653173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.653865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:21.655330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:21.687100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030d163-92e2-4ec1-97ae-04b27a0465c4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:21.705493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 68/144] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:21 2022] POST /identity/v3/users => generated 283 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:21.727345 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:21.728488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.729013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.729511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.730556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:21.731101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:21.732839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:21.743873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 77/145] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:21.751810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:21.884441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:21.930905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a76b6-d270-4461-833f-5fb2c9e4a5a3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:21.986143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:21.987049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:21.987340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:21.987622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] PATH_INFO: `/v3/users/e3a130eff1fb4a6fbe13e5b62045c85f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:21.992753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a130eff1fb4a6fbe13e5b62045c85f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:21.994328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:21.996913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 69/146] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:21 2022] GET /identity/v3/users/e3a130eff1fb4a6fbe13e5b62045c85f => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:22.002522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:22.058746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:22.123415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bebfa-b3e0-4698-afa1-7de1747bd608 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:22.173488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f478a-8d6f-41c4-9f4e-cb8b67715222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:22.174305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f478a-8d6f-41c4-9f4e-cb8b67715222 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:22.174592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f478a-8d6f-41c4-9f4e-cb8b67715222 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:22.174869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f478a-8d6f-41c4-9f4e-cb8b67715222 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:22.176200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f478a-8d6f-41c4-9f4e-cb8b67715222 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:22.177989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f478a-8d6f-41c4-9f4e-cb8b67715222 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:22.180129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 78/147] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:22 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:22.185981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:22.318908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581412f-7e91-48e8-9180-a151a5d5bee2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:22.362820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d54705-63b6-4744-80d5-f77aedfe1a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:22.363732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54705-63b6-4744-80d5-f77aedfe1a4e None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:22.364046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54705-63b6-4744-80d5-f77aedfe1a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:22.364327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54705-63b6-4744-80d5-f77aedfe1a4e None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91/users/e3a130eff1fb4a6fbe13e5b62045c85f/roles/87acdb843de948ef942863f1665147cb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:22.369066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d54705-63b6-4744-80d5-f77aedfe1a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=e304ec690b354614bc483c8980edbb91, user_id=e3a130eff1fb4a6fbe13e5b62045c85f, role_id=87acdb843de948ef942863f1665147cb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:22.371118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d54705-63b6-4744-80d5-f77aedfe1a4e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:22.393587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 70/148] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:22 2022] PUT /identity/v3/projects/e304ec690b354614bc483c8980edbb91/users/e3a130eff1fb4a6fbe13e5b62045c85f/roles/87acdb843de948ef942863f1665147cb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:22.613777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70467-da10-4452-835d-823d6e469248 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:22.614151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70467-da10-4452-835d-823d6e469248 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:22.614361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70467-da10-4452-835d-823d6e469248 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:22.615957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 79/149] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:22.621500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:22.621798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:22.622086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:22.627300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:22.643428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:22.644682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:22.750040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 71/150] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:22.794414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa70467-da10-4452-835d-823d6e469248 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:22.929848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa70467-da10-4452-835d-823d6e469248 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:22.944593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:22.970786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:22.971608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:22.971927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:22.972207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:22.985044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:22.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:22.993710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:22.994477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 80/151] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:23.001522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:23.118778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af13fd-888f-4197-9ce8-b56eb1189f2d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:23.164623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:23.170529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:23.171230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:23.171519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:23.171834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:23.172607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:23.172920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:23.174348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:23.189451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 72/152] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:23.195910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:23.310206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e5de-9505-4b0b-b3d6-a66e15721495 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:23.346125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:23.347076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:23.347365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:23.347643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:23.348903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:23.350470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:23.352329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 81/153] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:23 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:23.357713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:23.474957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0b0c-e60e-4f2e-a893-3ca392727637 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:23.530724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:23.531408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:23.531696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:23.532051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:23.623830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:23.632551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:23.634080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:23.776945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 73/154] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:23.782301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:23.838894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:23.911348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd2d7-bb9b-4829-9811-0f2614a2c6b3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:23.950555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913738-2e03-48f9-ad21-480261e6b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:23.951450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913738-2e03-48f9-ad21-480261e6b01d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:23.951735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913738-2e03-48f9-ad21-480261e6b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:23.952047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913738-2e03-48f9-ad21-480261e6b01d None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:23.953345 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b913738-2e03-48f9-ad21-480261e6b01d None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:23.954863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b913738-2e03-48f9-ad21-480261e6b01d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:23.956684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 82/155] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:23 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:23.962895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:24.102395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:24.110019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af6a7-40dc-4ccb-a771-08cd9f8c6cdf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:24.157211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:24.157894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:24.158180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:24.158457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:24.159310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=75faa1ace44b41f89a9a5c74487a0819) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:24.159625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:24.161154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c17beb-495e-4013-a3b8-eba0a9568ee8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:24.172957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 74/156] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:23 2022] GET /identity/v3/role_assignments?user.id=75faa1ace44b41f89a9a5c74487a0819&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=2dc775396d5544848b5553a1e7bf708b => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:24.690680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc46423-5e0d-4699-b333-4c62890f1677 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:24.691226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc46423-5e0d-4699-b333-4c62890f1677 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:24.691226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc46423-5e0d-4699-b333-4c62890f1677 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:24.692925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 83/157] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:24.708526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b95b6-3412-4d79-9afc-0c660b06ac43 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:24.708867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b95b6-3412-4d79-9afc-0c660b06ac43 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:24.709164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b95b6-3412-4d79-9afc-0c660b06ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:24.730217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bd4b95b6-3412-4d79-9afc-0c660b06ac43 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:24.731468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd4b95b6-3412-4d79-9afc-0c660b06ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:24.819493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 75/158] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:24.859200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc46423-5e0d-4699-b333-4c62890f1677 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:24.887917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867156-9f6b-4707-97da-f9bc28e8bacb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:24.888239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867156-9f6b-4707-97da-f9bc28e8bacb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:24.888489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867156-9f6b-4707-97da-f9bc28e8bacb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:24.889875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 76/159] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:24.895422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:24.895713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:24.896023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:24.922804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:24.924036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:25.023458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc46423-5e0d-4699-b333-4c62890f1677 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:25.044860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:25.080628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:25.081462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.081807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.082087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.093607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:25.105535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:25.106519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:25.107283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:25.109787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 84/160] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:25.115510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:25.118361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 77/161] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:25.146288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:25.203790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:25.332678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f22cab-240e-4f0e-9945-e4df2119a23b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:25.352304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a95b-d212-43e7-868d-7643eaf67a10 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:25.399176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022e045-0886-4989-b002-d6ac2090c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:25.400056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e045-0886-4989-b002-d6ac2090c184 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.400339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e045-0886-4989-b002-d6ac2090c184 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.400612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e045-0886-4989-b002-d6ac2090c184 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.405253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:25.405967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.406257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.406542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.407315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:25.407630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:25.409105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec363fd-bc89-46c4-bc28-30883b47a80b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:25.414359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022e045-0886-4989-b002-d6ac2090c184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3022e045-0886-4989-b002-d6ac2090c184 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:25.423220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:25.424208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:25.424982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:25.425572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 85/162] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:25.425572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c8fd-8aa4-49ec-99f6-d4e4f0904567 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.425572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c8fd-8aa4-49ec-99f6-d4e4f0904567 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.425750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c8fd-8aa4-49ec-99f6-d4e4f0904567 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.427229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 86/163] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:25.428579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 78/164] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:25.434785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c8fd-8aa4-49ec-99f6-d4e4f0904567 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:25.437682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.438175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.438708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.470880 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:25.478142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:25.488193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:25.618862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c8fd-8aa4-49ec-99f6-d4e4f0904567 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:25.680448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:25.681636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.682150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.682591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.683671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:25.684190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:25.688912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 79/165] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:25.688912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:25.689357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:25.704184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 87/166] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:25.709780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:25.710273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:25.891292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:25.892335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26140c1c-bd4c-452e-9757-e5a95035a4f4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:25.915883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970a22-a16c-4a52-8749-17d3114dac11 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:25.962937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:25.963946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:25.964737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:25.965013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:25.968540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:25.970051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:25.971748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 80/167] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:25 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:25.972537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:26.007552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:26.008495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.008778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.009047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] PATH_INFO: `/v3/users/85bd9af08cec4721bdd226bdaa9b2d35` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.012531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] RBAC: Authorizing `identity:get_user(user_id=85bd9af08cec4721bdd226bdaa9b2d35)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:26.014222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:26.016192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 88/168] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:25 2022] GET /identity/v3/users/85bd9af08cec4721bdd226bdaa9b2d35 => generated 247 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:26.018849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:26.132503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:26.167359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2278eaa-ba2d-438d-a51a-4a93527eb4c9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:26.228491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:26.229318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.229645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.229920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.231331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93f182-1610-47c8-ac03-48ad9b603796 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:26.248569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:26.262769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:26.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:26.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 81/169] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:26.265731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:26.297078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:26.297746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.298029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.298302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.364102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:26.436298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:26.438239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:26.447598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852380-14c8-42a9-905a-1e8eb94c5d64 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:26.529177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed554a-7f79-40bc-b8c6-580bbd5c1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:26.529849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed554a-7f79-40bc-b8c6-580bbd5c1038 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.530134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed554a-7f79-40bc-b8c6-580bbd5c1038 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.530413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed554a-7f79-40bc-b8c6-580bbd5c1038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.536104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:26.605922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 89/170] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:26.607244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:26.667875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed554a-7f79-40bc-b8c6-580bbd5c1038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:26.671077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed554a-7f79-40bc-b8c6-580bbd5c1038 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:26.721704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:26.806059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f73d1-9e7d-4640-b420-4e458e0cccd9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:26.811643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 82/171] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:26.813515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f6f4-02ba-4079-9f73-a79e9afff842 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.814005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f6f4-02ba-4079-9f73-a79e9afff842 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.814492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f6f4-02ba-4079-9f73-a79e9afff842 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.820242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 83/172] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:26.821435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3f6f4-02ba-4079-9f73-a79e9afff842 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:26.861985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:26.881965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:26.883018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.883420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.883809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.884940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:26.885325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:26.887555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:26.897556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 90/173] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:26.898691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:26.944017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3f6f4-02ba-4079-9f73-a79e9afff842 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:26.982743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7071324-77f5-41e0-b7c8-b0b0e7e0b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:26.983589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7071324-77f5-41e0-b7c8-b0b0e7e0b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.983911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7071324-77f5-41e0-b7c8-b0b0e7e0b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.987038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7071324-77f5-41e0-b7c8-b0b0e7e0b9c3 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:26.988584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7071324-77f5-41e0-b7c8-b0b0e7e0b9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:26.990481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7071324-77f5-41e0-b7c8-b0b0e7e0b9c3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:26.992649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 84/174] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:26 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:26.993759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ff65-5051-4881-9f80-5d378b077881 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:26.994044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ff65-5051-4881-9f80-5d378b077881 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:26.994316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ff65-5051-4881-9f80-5d378b077881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.012338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0621ff65-5051-4881-9f80-5d378b077881 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:27.013521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0621ff65-5051-4881-9f80-5d378b077881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:27.015292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129a99f-364a-41dc-bcb5-4e5cdc7f44c2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.038576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.050321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5c8b8-2f3c-4b16-95da-4118c3fcb67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.051311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5c8b8-2f3c-4b16-95da-4118c3fcb67c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.051597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5c8b8-2f3c-4b16-95da-4118c3fcb67c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.052174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5c8b8-2f3c-4b16-95da-4118c3fcb67c None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.053367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5c8b8-2f3c-4b16-95da-4118c3fcb67c None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:27.054829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5c8b8-2f3c-4b16-95da-4118c3fcb67c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:27.058099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 91/175] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:26 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:27.058099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d9ed1-a7ea-4335-b064-eb6ede190533 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.058277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d9ed1-a7ea-4335-b064-eb6ede190533 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.058469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d9ed1-a7ea-4335-b064-eb6ede190533 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.059692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 92/176] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:27.064174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d9ed1-a7ea-4335-b064-eb6ede190533 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.103598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 85/177] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:27.103598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede37939-6f66-4b4a-873a-52b5a9b63408 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.103598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede37939-6f66-4b4a-873a-52b5a9b63408 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.103598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede37939-6f66-4b4a-873a-52b5a9b63408 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.103598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 86/178] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:27.103598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede37939-6f66-4b4a-873a-52b5a9b63408 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.142035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.183514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d9ed1-a7ea-4335-b064-eb6ede190533 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.211712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede37939-6f66-4b4a-873a-52b5a9b63408 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.220779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.222027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.222482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.223007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] PATH_INFO: `/v3/users/75faa1ace44b41f89a9a5c74487a0819` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.224580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] RBAC: Authorizing `identity:get_user(user_id=75faa1ace44b41f89a9a5c74487a0819)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:27.226563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:27.228403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 93/179] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/users/75faa1ace44b41f89a9a5c74487a0819 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:27.229306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.254480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.255076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.255357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.255637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.256517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] RBAC: Adding query filter params (role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=75faa1ace44b41f89a9a5c74487a0819) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:27.256832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:27.258302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d04bb-afdd-4eae-8896-c8b9e7c80a59 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:27.264764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 87/180] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/role_assignments?user.id=75faa1ace44b41f89a9a5c74487a0819&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:27.274205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ba3c2-923a-47d6-b26f-a841f6e88b09 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.274789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ba3c2-923a-47d6-b26f-a841f6e88b09 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.275243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ba3c2-923a-47d6-b26f-a841f6e88b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.298464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d71ba3c2-923a-47d6-b26f-a841f6e88b09 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:27.299719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d71ba3c2-923a-47d6-b26f-a841f6e88b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:27.301347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.362435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67119b5f-335f-4a25-8cb8-29951689fea9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.383780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 88/181] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:27.383780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.383780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.383780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.409881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:27.411360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:27.428830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.429503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.429786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.430063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.431083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=85bd9af08cec4721bdd226bdaa9b2d35) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:27.431405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:27.433145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:27.440054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.440240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 94/182] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/role_assignments?user.id=85bd9af08cec4721bdd226bdaa9b2d35&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:27.444604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.507797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 89/183] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:27.508634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.603867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e60f8-1f3e-47d3-b9a7-934c0c82e4f9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.632577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.634677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6dbce-c6ff-4793-a466-9dafd6b9e6db None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.653879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd83ad-cccf-45d1-b4b7-21badb85fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.654691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd83ad-cccf-45d1-b4b7-21badb85fe06 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.654976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd83ad-cccf-45d1-b4b7-21badb85fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.655252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd83ad-cccf-45d1-b4b7-21badb85fe06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.668843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd83ad-cccf-45d1-b4b7-21badb85fe06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2abd83ad-cccf-45d1-b4b7-21badb85fe06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:27.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:27.678773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:27.679693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:27.680492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.680492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.680655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 95/184] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:27.680740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.680740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.680878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d54-8037-4611-b414-344d7171208a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.680878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d54-8037-4611-b414-344d7171208a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.680878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d54-8037-4611-b414-344d7171208a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.683013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 96/185] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:27.684660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d54-8037-4611-b414-344d7171208a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.713405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.762371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:27.763818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:27.794753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d54-8037-4611-b414-344d7171208a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.829131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:27.829924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:27.830202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:27.830470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:27.840605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:27.848191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:27.849113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:27.849905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 97/186] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:27.850644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.872085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 90/187] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:27.873025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:27.909277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.940941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:27.981493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942488-41a3-4874-809e-08c5a378c895 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:27.983651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30937-c406-4b92-ba61-05cf46019e77 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.020469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.021213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.021486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.021669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.021817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.022351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.022637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.022910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.023669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:28.024011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.025517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6324-926f-48c5-8a5e-c6fc0ac5a925 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.032483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:28.039254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 91/188] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:28.048603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:28.049605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:28.050677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:28.051416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.051416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.051416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.051626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 98/189] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:28.051626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.065130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:28.066357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:28.134489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 92/190] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:28.135325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.153413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991c58b-0c96-47c4-a697-e00f708f2c73 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.155710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.188871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.193544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.194283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.194574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.194855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.195611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:28.195945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.197341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.206087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 99/191] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.206898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.240698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99f6a5-af20-48f3-a131-136a0660c210 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.275783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.276627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.276909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.277181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] PATH_INFO: `/v3/projects/0c57b085ddc74ec487926663a37f6651` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.278387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] RBAC: Authorizing `identity:get_project(project_id=0c57b085ddc74ec487926663a37f6651)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.279879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.281579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 93/192] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/projects/0c57b085ddc74ec487926663a37f6651 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.282354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.317490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da54be-a90b-49bf-ba48-56b43d11b979 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.351662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.352677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.352958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.353229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] PATH_INFO: `/v3/users/5c24650483b94855a27400597d37aa17` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.366904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] RBAC: Authorizing `identity:get_user(user_id=5c24650483b94855a27400597d37aa17)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.368459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.370666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 100/193] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/users/5c24650483b94855a27400597d37aa17 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.375197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.390397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9477ee-9be9-4aa1-9312-970d04e10e13 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.397117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.408297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.426251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.427403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.427683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.428005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.428749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:28.429057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.430475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.438509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 94/194] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.443228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.475116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563339e-9fdd-42c1-8f3e-5efd367e3e8c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.511197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.512018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.512301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.512574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.513804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.515269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.517102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 101/195] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.517706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.547163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927322a-2c23-41c2-be23-902c4257279e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.581192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.582078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.582410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.582646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] PATH_INFO: `/v3/users/e3a130eff1fb4a6fbe13e5b62045c85f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.583883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] RBAC: Authorizing `identity:get_user(user_id=e3a130eff1fb4a6fbe13e5b62045c85f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.585367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.587020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 95/196] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/users/e3a130eff1fb4a6fbe13e5b62045c85f => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.587803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.614369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.623423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333460db-9fbb-476d-8e2a-8df3ff5025c4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.636807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.657240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.657888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.658167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.658439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.659259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=0c57b085ddc74ec487926663a37f6651, user.id=75faa1ace44b41f89a9a5c74487a0819) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:28.659564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.661043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.666760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 102/197] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/role_assignments?user.id=75faa1ace44b41f89a9a5c74487a0819&scope.project.id=0c57b085ddc74ec487926663a37f6651&role.id=2dc775396d5544848b5553a1e7bf708b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.668150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.703255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf384-ad1c-414b-8f8b-2435e0eaac6e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.743468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.744260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.744556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.744807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.790081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274cbd5-e019-49a8-924d-b97cf1aace15 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:28.827383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.828824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.831011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:28.832035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:28.832315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:28.832590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] PATH_INFO: `/v3/users/5c24650483b94855a27400597d37aa17` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:28.833916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] RBAC: Authorizing `identity:get_user(user_id=5c24650483b94855a27400597d37aa17)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:28.835442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:28.837382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 103/198] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/users/5c24650483b94855a27400597d37aa17 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:28.837928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.866667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.887613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:28.954812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 96/199] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:28.955984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:28.967895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58adfdd-d7b2-41b3-9a56-8dbf7c18b577 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.006161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.006839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.007129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.007403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.008149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.009640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.031088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 104/200] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:28 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:29.031088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.067319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7397c-6647-4779-8af2-96d7c639b060 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.111832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.112460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.112747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.113089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.136291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.137024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.166104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2c18-faca-41c4-974d-e5c7a2e62c9a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.201344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.203138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.211684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.213480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.213991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.214444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.307227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.310006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.330954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 97/201] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:29.332433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.395540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.413918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.438455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 105/202] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:29.440112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.472996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558475-5e8d-4969-8b4c-301a6e46f53c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.509211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.510246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.510631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.511506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.512864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.514477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.516362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 98/203] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:29.517237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.563347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79febd-558c-4f31-8354-a777c0daa5d7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.605061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.606291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.606578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.606857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.608398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.610425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.612734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 106/204] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:29.613902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.633544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41093a5c-f985-41a1-8dc3-376531a62d2d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.653800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.680610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.681842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.683607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.684075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.684943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.686605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.688751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.691365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 99/205] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:29.692682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.739583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c4a0-0c5e-484a-822b-aa94581ef995 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.783885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.784875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.785243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.785589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.786588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=5c24650483b94855a27400597d37aa17) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:29.786973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.788813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.795636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 107/206] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/role_assignments?user.id=5c24650483b94855a27400597d37aa17&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:29.796672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:29.816154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1a66-1445-478a-9e81-331f8f1cb10e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.862556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.863505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.863819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.864106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.865122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] RBAC: Adding query filter params (role.id=87acdb843de948ef942863f1665147cb, scope.project.id=e304ec690b354614bc483c8980edbb91, user.id=e3a130eff1fb4a6fbe13e5b62045c85f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:29.865440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.867545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b622a9f-af13-46b6-9b11-083be3a3b03e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.876749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 100/207] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/role_assignments?user.id=e3a130eff1fb4a6fbe13e5b62045c85f&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=87acdb843de948ef942863f1665147cb => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:29.928983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717445-a9db-46a4-b637-0173864e8262 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:29.950347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:29.981279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:29.982154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:29.982441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:29.982718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:29.983577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] RBAC: Adding query filter params (role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=5c24650483b94855a27400597d37aa17) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:29.983923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:29.985429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439c22-e87a-4e91-aca1-8f2599b9f5ee None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:29.992154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 108/208] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:29 2022] GET /identity/v3/role_assignments?user.id=5c24650483b94855a27400597d37aa17&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:31.586417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67086c5-2ea7-4aa4-bfb9-1f5ba4a28a9f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:31.587415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67086c5-2ea7-4aa4-bfb9-1f5ba4a28a9f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:31.587415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67086c5-2ea7-4aa4-bfb9-1f5ba4a28a9f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:31.588386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 101/209] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:31.593944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239324-9519-4b49-9539-380bedb31246 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:31.594692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239324-9519-4b49-9539-380bedb31246 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:31.594692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239324-9519-4b49-9539-380bedb31246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:31.611788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-94239324-9519-4b49-9539-380bedb31246 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:31.613056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-94239324-9519-4b49-9539-380bedb31246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:31.690726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 109/210] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:31.709393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67086c5-2ea7-4aa4-bfb9-1f5ba4a28a9f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:31.782363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:31.882946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67086c5-2ea7-4aa4-bfb9-1f5ba4a28a9f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:31.949824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73a15f-397c-420c-a1f2-a0527fbab86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:31.951726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a15f-397c-420c-a1f2-a0527fbab86b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:31.952556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a15f-397c-420c-a1f2-a0527fbab86b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:31.953323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a15f-397c-420c-a1f2-a0527fbab86b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:31.973743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73a15f-397c-420c-a1f2-a0527fbab86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9b73a15f-397c-420c-a1f2-a0527fbab86b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:31.994424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:31.995963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:31.996766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:31.997354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 102/211] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:32.006227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239324-9519-4b49-9539-380bedb31246 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.192132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239324-9519-4b49-9539-380bedb31246 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.207090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:32.216056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcbe98-4c82-4b62-b513-f0db273b57ee None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.216891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcbe98-4c82-4b62-b513-f0db273b57ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.217662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcbe98-4c82-4b62-b513-f0db273b57ee None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.220592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 103/212] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:32.227895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93304c58-5eb0-478a-bf8d-3bc0e2c33824 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.228706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93304c58-5eb0-478a-bf8d-3bc0e2c33824 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.230049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93304c58-5eb0-478a-bf8d-3bc0e2c33824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.247792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.248488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.248771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.249046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.249800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:32.250108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:32.251531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:32.260992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 110/213] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:32.265738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-93304c58-5eb0-478a-bf8d-3bc0e2c33824 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:32.266507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.268435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-93304c58-5eb0-478a-bf8d-3bc0e2c33824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:32.366004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 104/214] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:32.367416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f705-7749-4263-bcc9-3795da702c2c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.367705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f705-7749-4263-bcc9-3795da702c2c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.368011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f705-7749-4263-bcc9-3795da702c2c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.369292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 105/215] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:32.378441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.378928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.379384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.383730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaa68b-930a-4156-b719-0beef8020d7f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.397922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:32.399119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:32.422404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.423292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.423577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.423889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] PATH_INFO: `/v3/users/2112146a059f4106817517c17ab6b4bb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.431240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:32.441316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] RBAC: Authorizing `identity:get_user(user_id=2112146a059f4106817517c17ab6b4bb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:32.443022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:32.449165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 111/216] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/users/2112146a059f4106817517c17ab6b4bb => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:32.449165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.473833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 106/217] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:32.484013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.492379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:32.574665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491800a-21fb-416e-badc-c524b9e66f4b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.582333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2169-e476-4e23-b626-199b45ab5069 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.609996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.610803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.611134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.611374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.612572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:32.614034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:32.619598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.620330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 112/218] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:32.620643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.620922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.621033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.621227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.663093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:32.701156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:32.702585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:32.734617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:32.743221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d0265-c79f-40c3-8e91-5d275212d156 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.780001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.780814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.781096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.781370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.792913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:32.800755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:32.801984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:32.802782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 113/219] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:32.803443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.821969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 107/220] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:32.823726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.899425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:32.914603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22ba5e-e335-4148-9430-15a761362d59 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.941421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d0ee-6e96-425f-98d3-50f2ab54c454 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:32.953500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.954380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.954664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.954942 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.955843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:32.957672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:32.980582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:32.981493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:32.981599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 114/221] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:32 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:32.982245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:32.992162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:32.992504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:32.993342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:32.993661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:32.995629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.002037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:33.014283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 108/222] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:33.016680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:33.117969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7f4da-5e31-4598-9198-3a7d32c5cbc2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.137354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c052-8d1f-4b15-b0ec-d557bf840244 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.158427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacabf8-d385-44f2-bc05-29db89cbf245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.159715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacabf8-d385-44f2-bc05-29db89cbf245 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.160098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacabf8-d385-44f2-bc05-29db89cbf245 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.160474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacabf8-d385-44f2-bc05-29db89cbf245 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.161757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacabf8-d385-44f2-bc05-29db89cbf245 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:33.163292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacabf8-d385-44f2-bc05-29db89cbf245 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.165267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 115/223] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:32 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:33.166387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8071-65cb-4699-83db-6d4871a90a6f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.166673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8071-65cb-4699-83db-6d4871a90a6f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.166995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8071-65cb-4699-83db-6d4871a90a6f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.168333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 116/224] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:33.173153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:33.173327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8071-65cb-4699-83db-6d4871a90a6f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:33.181041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417771e3-2220-45c5-a601-6f71a3a91cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.181940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417771e3-2220-45c5-a601-6f71a3a91cee None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.182225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417771e3-2220-45c5-a601-6f71a3a91cee None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.183040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417771e3-2220-45c5-a601-6f71a3a91cee None admin] PATH_INFO: `/v3/users/5c24650483b94855a27400597d37aa17` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.184323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417771e3-2220-45c5-a601-6f71a3a91cee None admin] RBAC: Authorizing `identity:get_user(user_id=5c24650483b94855a27400597d37aa17)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:33.187220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417771e3-2220-45c5-a601-6f71a3a91cee None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.195876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 109/225] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:33 2022] GET /identity/v3/users/5c24650483b94855a27400597d37aa17 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:33.195876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.195876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.195876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.212005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:33.213219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:33.279832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:33.322263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 110/226] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:33.323671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:33.327694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8071-65cb-4699-83db-6d4871a90a6f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.371309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.372022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.372312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.372590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.373433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=2112146a059f4106817517c17ab6b4bb) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:33.373748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:33.375232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.392366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 117/227] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:33 2022] GET /identity/v3/role_assignments?user.id=2112146a059f4106817517c17ab6b4bb&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=2dc775396d5544848b5553a1e7bf708b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:33.393250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:33.477105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecad5a-34f5-4dec-907f-36987d8ed29b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.524388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:33.544644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.545920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.546436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.546908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.549544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:33.552147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.555404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 111/228] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:33 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:33.562745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:33.628267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81cbc2-d783-4e99-9da9-1a637ea72ba7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.681505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.682427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.682955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.683374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.695721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:33.704868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:33.705782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:33.706559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 118/229] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:33.715840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77eb2c-d1db-495c-818a-ecac49207487 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.719280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:33.732196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:33.807811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.808731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.809014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.809290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c/users/5c24650483b94855a27400597d37aa17/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.815313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] RBAC: Authorizing `identity:create_grant(project_id=797ec60568f642e891fad08f02650c2c, user_id=5c24650483b94855a27400597d37aa17, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:33.816832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.849278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 112/230] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:33 2022] PUT /identity/v3/projects/797ec60568f642e891fad08f02650c2c/users/5c24650483b94855a27400597d37aa17/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 08:50:33.881305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e664199-a84e-453c-96a9-89e57609bb6e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:33.930643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:33.932230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:33.932765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:33.933317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:33.934474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:33.934998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:33.936769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:33.954113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 119/231] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:33.961484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:34.062695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:34.121425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05ffe0-5d2a-4b77-bc9a-dfa4fee30a80 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:34.161783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:34.162675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:34.162956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:34.163229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] PATH_INFO: `/v3/users/5c24650483b94855a27400597d37aa17` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:34.164458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] RBAC: Authorizing `identity:get_user(user_id=5c24650483b94855a27400597d37aa17)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:34.165920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:34.167930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 113/232] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:33 2022] GET /identity/v3/users/5c24650483b94855a27400597d37aa17 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:34.173039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:34.260159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:34.319113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f2b65-de34-4cf7-a9e4-a269136dcb90 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:34.361301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20d941-7b18-4844-96db-d990d8ffe166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:34.362226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20d941-7b18-4844-96db-d990d8ffe166 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:34.362517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20d941-7b18-4844-96db-d990d8ffe166 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:34.362795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20d941-7b18-4844-96db-d990d8ffe166 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:34.368580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20d941-7b18-4844-96db-d990d8ffe166 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:34.370114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20d941-7b18-4844-96db-d990d8ffe166 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:34.372183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 120/233] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:34 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:34.377455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:34.542903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0b85-d057-4263-bd60-b1e565a2b545 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:34.583788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:34.595746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23c088-4243-4890-9e9c-f619900f4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:34.596691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23c088-4243-4890-9e9c-f619900f4f9a None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:34.596963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23c088-4243-4890-9e9c-f619900f4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:34.597241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23c088-4243-4890-9e9c-f619900f4f9a None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c/users/5c24650483b94855a27400597d37aa17/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:34.599546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23c088-4243-4890-9e9c-f619900f4f9a None admin] RBAC: Authorizing `identity:create_grant(project_id=797ec60568f642e891fad08f02650c2c, user_id=5c24650483b94855a27400597d37aa17, role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:34.601080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23c088-4243-4890-9e9c-f619900f4f9a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:34.621000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 114/234] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:34 2022] PUT /identity/v3/projects/797ec60568f642e891fad08f02650c2c/users/5c24650483b94855a27400597d37aa17/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:35.943928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca16e-e242-4df3-ae3d-d3ea7396e6aa None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:35.944978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca16e-e242-4df3-ae3d-d3ea7396e6aa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:35.945457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca16e-e242-4df3-ae3d-d3ea7396e6aa None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:35.947055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 121/235] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:35.953308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f1bf-f8dd-47ed-8482-db058f1f0e7c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:35.954262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f1bf-f8dd-47ed-8482-db058f1f0e7c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:35.954725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f1bf-f8dd-47ed-8482-db058f1f0e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:35.982618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b7c5f1bf-f8dd-47ed-8482-db058f1f0e7c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:35.984539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b7c5f1bf-f8dd-47ed-8482-db058f1f0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:36.081221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 115/236] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:36.105196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca16e-e242-4df3-ae3d-d3ea7396e6aa None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.193032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73704e8-80f1-49f7-a381-7f50cd433bbe None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.193355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73704e8-80f1-49f7-a381-7f50cd433bbe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.193573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73704e8-80f1-49f7-a381-7f50cd433bbe None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.195014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 116/237] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:36.200751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c048fa-fc86-46f9-a3ff-5b59eb1fba4c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.201035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c048fa-fc86-46f9-a3ff-5b59eb1fba4c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.201315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c048fa-fc86-46f9-a3ff-5b59eb1fba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.219630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca16e-e242-4df3-ae3d-d3ea7396e6aa None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:36.226821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c3c048fa-fc86-46f9-a3ff-5b59eb1fba4c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:36.228899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c3c048fa-fc86-46f9-a3ff-5b59eb1fba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:36.258762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:36.267654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015216af-35ee-4c7d-a7b0-77b481bb6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:36.268445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015216af-35ee-4c7d-a7b0-77b481bb6b52 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.269018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015216af-35ee-4c7d-a7b0-77b481bb6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.269215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015216af-35ee-4c7d-a7b0-77b481bb6b52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.282521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015216af-35ee-4c7d-a7b0-77b481bb6b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-015216af-35ee-4c7d-a7b0-77b481bb6b52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:36.290443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:36.291371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:36.292774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 122/238] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:36.298221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3043-3c8f-43a4-a295-758eef3b4ebc None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.298507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3043-3c8f-43a4-a295-758eef3b4ebc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.298785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3043-3c8f-43a4-a295-758eef3b4ebc None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.300475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 123/239] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:36.305647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d3043-3c8f-43a4-a295-758eef3b4ebc None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.335614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 117/240] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:36.342907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.342907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.342907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.360355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:36.361531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:36.424145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:36.449973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d3043-3c8f-43a4-a295-758eef3b4ebc None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:36.456656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 118/241] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:36.457549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.507112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:36.507979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.508265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.508857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.509904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:36.510216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:36.511665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:36.524302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 124/242] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:36.525255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.586962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230956e-2e57-40e4-948b-2f62f410a25c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:36.597048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:36.626168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:36.626986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.627261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.627590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.641128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:36.650102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:36.651664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:36.652510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 119/243] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:36.653454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.661244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12b503-9fca-45f2-9075-eaccca92b2e6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:36.697089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:36.707778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:36.709111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.709688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.710210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.711724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:36.714671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:36.722113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 125/244] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:36.722113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.784812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7b02-bc37-4781-89ec-9ee24dc25264 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:36.821139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:36.821977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.822254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.822775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] PATH_INFO: `/v3/users/5b706ef18ec24400b1f967086327be51` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.837720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] RBAC: Authorizing `identity:get_user(user_id=5b706ef18ec24400b1f967086327be51)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:36.839719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:36.841447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 120/245] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/users/5b706ef18ec24400b1f967086327be51 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:36.844104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8a0a-474b-479c-abe7-b93ffc8e8de2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:36.846539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.874542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:36.888315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:36.889075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.889288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.889546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.890350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:36.890663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:36.892138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108cbfb-c06f-4056-bcee-bac102de2039 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:36.901955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 126/246] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:36.903254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b1ca-b6be-4648-ae41-ba4fb113e5ea None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:36.903540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b1ca-b6be-4648-ae41-ba4fb113e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:36.907878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b1ca-b6be-4648-ae41-ba4fb113e5ea None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:36.907878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 127/247] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:36.907878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b1ca-b6be-4648-ae41-ba4fb113e5ea None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:36.948578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:36.958577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b3d6d-f22d-4e75-8bb0-5e8d00b8ee59 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.010959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.011746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.012127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.012476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.013368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.014865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.041094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b1ca-b6be-4648-ae41-ba4fb113e5ea None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.041614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 121/248] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:36 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:37.042778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.100229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.100963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.101279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.101971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.180210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:37.181289 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e33ba8-b656-4442-a988-6134ba39c340 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.200792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.203069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.223500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f5c6-e9bd-4150-8fee-17f257ee432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.224506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f5c6-e9bd-4150-8fee-17f257ee432f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.224794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f5c6-e9bd-4150-8fee-17f257ee432f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.225067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f5c6-e9bd-4150-8fee-17f257ee432f None admin] PATH_INFO: `/v3/users/2112146a059f4106817517c17ab6b4bb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.226375 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f5c6-e9bd-4150-8fee-17f257ee432f None admin] RBAC: Authorizing `identity:get_user(user_id=2112146a059f4106817517c17ab6b4bb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.228026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f5c6-e9bd-4150-8fee-17f257ee432f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.229866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 122/249] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:37 2022] GET /identity/v3/users/2112146a059f4106817517c17ab6b4bb => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:37.231163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.231514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.231713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.249972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:37.251257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:37.264438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:37.341637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 123/250] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:37.342906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.347302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 128/251] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:37.352907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.460314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:37.475711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf60b-6043-4a80-a0d1-dba5c61a69bd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.478038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5209296-33c4-43f1-8a36-519c605e8058 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.515604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.516519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.516802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.517066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.517926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.518269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.519254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.519730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.519849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.520306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.521734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.521840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:37 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:37.522569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.527968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.530255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 124/253] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:37 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:37.532339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.550256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:37.662676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34dab5-9a4a-456f-82e3-cf43d442b751 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.670890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96011e01-4c21-48c2-8c5c-5a9591e6da2f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.716407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e9133-25f6-4526-9b85-7dddb85e7568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.717691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9133-25f6-4526-9b85-7dddb85e7568 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.717977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9133-25f6-4526-9b85-7dddb85e7568 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.718552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9133-25f6-4526-9b85-7dddb85e7568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.730685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.731296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e9133-25f6-4526-9b85-7dddb85e7568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:37.732116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.732750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.733370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.735186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] RBAC: Adding query filter params (role.id=87acdb843de948ef942863f1665147cb, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=5b706ef18ec24400b1f967086327be51) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:37.735942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.738968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bf7e9133-25f6-4526-9b85-7dddb85e7568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:37.739145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:37.740026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:37.741395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 130/254] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:37.742893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982809d0-c3b7-4298-9792-eba944782202 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.742893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982809d0-c3b7-4298-9792-eba944782202 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.742893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982809d0-c3b7-4298-9792-eba944782202 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.745379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 131/255] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:37.745629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982809d0-c3b7-4298-9792-eba944782202 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.756454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 125/256] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:37 2022] GET /identity/v3/role_assignments?user.id=5b706ef18ec24400b1f967086327be51&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=87acdb843de948ef942863f1665147cb => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:37.757846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:37.768841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:37.888530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982809d0-c3b7-4298-9792-eba944782202 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:37.964899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6f6d3-3f02-4bcf-9bbf-5b31fecba2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:37.965840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6f6d3-3f02-4bcf-9bbf-5b31fecba2d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:37.966130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6f6d3-3f02-4bcf-9bbf-5b31fecba2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:37.966411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6f6d3-3f02-4bcf-9bbf-5b31fecba2d3 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c/users/2112146a059f4106817517c17ab6b4bb/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:37.970444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6f6d3-3f02-4bcf-9bbf-5b31fecba2d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=797ec60568f642e891fad08f02650c2c, user_id=2112146a059f4106817517c17ab6b4bb, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:37.971977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6f6d3-3f02-4bcf-9bbf-5b31fecba2d3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:37.977251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:38.004294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 132/257] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:37 2022] PUT /identity/v3/projects/797ec60568f642e891fad08f02650c2c/users/2112146a059f4106817517c17ab6b4bb/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:38.008307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.008598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.008881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.031588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db219c-1cbb-4b48-aa13-5b5098781ba1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.043881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:38.045136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:38.107361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:38.108142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.108428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.108706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.109469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:38.109783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:38.111219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:38.124993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 126/258] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:38.130527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:38.139072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 133/259] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:38.180863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:38.183343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:38.301166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321517e6-9557-4c2a-a476-6baa402c1b25 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.349448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288e95-96b3-43e1-851b-d56c1396bc27 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.380638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:38.381626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.381912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.382192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] PATH_INFO: `/v3/users/5c24650483b94855a27400597d37aa17` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.383719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] RBAC: Authorizing `identity:get_user(user_id=5c24650483b94855a27400597d37aa17)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:38.385329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:38.387494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 127/260] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:38 2022] GET /identity/v3/users/5c24650483b94855a27400597d37aa17 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:38.390253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:38.391134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.391425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.391682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.392602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:38.408052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:38.416649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:38.426035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:38.428569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:38.430426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 134/261] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:38.437375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:38.507200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:38.550273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a539dd-f54c-4404-b868-f31b193acf09 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.553203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eebf80-d731-48a2-b028-cc6f8b8769b9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.592866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:38.593550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.593835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.594114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.594869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:38.595181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:38.599777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:38.605629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 135/262] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:38.611040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:38.645436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:38.646444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.646921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.647386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.731490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16996b4-de42-4ac4-8787-04a4eaa72f1c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.758540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:38.772409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:38.773429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:38.773714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:38.774009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] PATH_INFO: `/v3/users/5c24650483b94855a27400597d37aa17` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:38.775234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] RBAC: Authorizing `identity:get_user(user_id=5c24650483b94855a27400597d37aa17)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:38.776860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:38.779155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 136/263] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:38 2022] GET /identity/v3/users/5c24650483b94855a27400597d37aa17 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:38.784599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:38.813186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:38.815745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:38.827258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:38.952423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbb281-0031-46d2-9ecf-d18e2f45c861 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:38.995285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 128/264] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 08:50:39.001520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:39.025496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:39.026761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:39.027176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:39.027582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:39.165869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cba79-fce8-49c5-9218-687ac11e4c74 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:39.175920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:39.190669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:39.192255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:39.194127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:39.284516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:39.285415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:39.285702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:39.285981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:39.287261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:39.288842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:39.290918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 129/265] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:39 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:39.297235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:39.363422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 137/266] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 08:50:39.369266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:39.502606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf5437-4ff8-4a14-a0da-1ecb61fae186 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:39.567943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:39.569084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:39.569931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:39.570492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:39.570899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:39.572025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=5c24650483b94855a27400597d37aa17) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:39.572441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:39.575551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:39.583645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 130/267] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:39 2022] GET /identity/v3/role_assignments?user.id=5c24650483b94855a27400597d37aa17&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:39.585731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd783d-8970-43c7-87ae-9d343bf26aa5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:39.645780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b65c4-bc0a-4bdb-a172-3219f939b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:39.646701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b65c4-bc0a-4bdb-a172-3219f939b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:39.646982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b65c4-bc0a-4bdb-a172-3219f939b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:39.647255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b65c4-bc0a-4bdb-a172-3219f939b0c3 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:39.648579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b65c4-bc0a-4bdb-a172-3219f939b0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:39.650111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b65c4-bc0a-4bdb-a172-3219f939b0c3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:39.652795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 138/268] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:39 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:39.658433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:39.735813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:39.821448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063718e6-048a-45c4-a032-2a65508885e8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:39.863970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:39.865080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:39.865688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:39.866160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:39.867215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] RBAC: Adding query filter params (role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=5c24650483b94855a27400597d37aa17) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:39.867768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:39.869501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33913261-77eb-41c5-b790-196c175c8f1f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:39.880671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 131/269] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:39 2022] GET /identity/v3/role_assignments?user.id=5c24650483b94855a27400597d37aa17&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:40.103493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f956c-f096-4130-8b65-5fcee0359b7f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.104694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f956c-f096-4130-8b65-5fcee0359b7f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.105208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f956c-f096-4130-8b65-5fcee0359b7f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.107082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 139/270] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:40.113114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed929-7245-48e7-b9c9-b474c49d81c9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.113977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed929-7245-48e7-b9c9-b474c49d81c9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.114493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed929-7245-48e7-b9c9-b474c49d81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.136233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-991ed929-7245-48e7-b9c9-b474c49d81c9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:40.137534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-991ed929-7245-48e7-b9c9-b474c49d81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:40.218135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 132/271] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:40.244194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f956c-f096-4130-8b65-5fcee0359b7f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:40.378199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f956c-f096-4130-8b65-5fcee0359b7f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:40.385359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775818b-08bf-4b8a-9be1-7e831542953a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.385654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775818b-08bf-4b8a-9be1-7e831542953a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.386100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775818b-08bf-4b8a-9be1-7e831542953a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.387942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 133/272] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:40.394267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.394884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.395251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.414324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:40.415921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:40.432570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:40.433724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.434182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.434625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.447308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:40.448031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:40.459461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:40.460600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:40.461423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:40.464304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 140/273] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:40.469948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:40.500168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:40.502419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 134/274] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:40.544417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:40.633618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f5498-2186-4526-8e99-6aac5bcafcf4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:40.681904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06943f1-e37d-4632-b88e-b2c828ab3b5d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:40.682121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:40.682722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.683010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.683290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.684085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:40.684399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:40.686167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:40.701822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 141/275] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:40.707838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:40.730410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:40.731338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.731847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.732464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.733738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:40.735370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:40.741942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 135/276] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:40.745561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:40.783346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:40.826075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:40.847903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc409-c536-489a-8cd6-7fd1c662b145 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:40.860878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5929f9-a019-445e-be89-b78a058d5f09 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:40.889071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:40.890466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.891000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.891480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] PATH_INFO: `/v3/users/b3aee6ff441140a59b6ee06e883b59f0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.901843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b448e6-a36c-4bd2-873f-ad9d5489959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:40.902372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b448e6-a36c-4bd2-873f-ad9d5489959f None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:40.902656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b448e6-a36c-4bd2-873f-ad9d5489959f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:40.902936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b448e6-a36c-4bd2-873f-ad9d5489959f None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:40.903691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b448e6-a36c-4bd2-873f-ad9d5489959f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:40.905284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b448e6-a36c-4bd2-873f-ad9d5489959f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:40.910324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] RBAC: Authorizing `identity:get_user(user_id=b3aee6ff441140a59b6ee06e883b59f0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:40.912255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:40.914921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 142/277] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:40 2022] GET /identity/v3/users/b3aee6ff441140a59b6ee06e883b59f0 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:40.921158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:40.939606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 136/278] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:50:40 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:50:41.048143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97b35-819c-4b35-833b-9f1d89f36bcb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:41.089511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:41.090231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.090803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.091084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.092004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, user.id=b3aee6ff441140a59b6ee06e883b59f0, scope.system=all) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:41.092329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:41.093874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf7af-385f-4e85-a7fa-14a93c40d224 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:41.100563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 143/279] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 08:50:40 2022] GET /identity/v3/role_assignments?user.id=b3aee6ff441140a59b6ee06e883b59f0&scope.system=all&role.id=2dc775396d5544848b5553a1e7bf708b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:41.288124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b39-2677-466e-8db4-8aaf68681a97 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.289162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b39-2677-466e-8db4-8aaf68681a97 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.289662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b39-2677-466e-8db4-8aaf68681a97 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.291462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 137/280] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:41.298298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.298835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.298835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.305976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:41.320566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:41.321839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:41.409310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 144/281] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:41.432099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b39-2677-466e-8db4-8aaf68681a97 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:41.538918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:41.555126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b39-2677-466e-8db4-8aaf68681a97 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:41.592058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66834917-a73d-4655-b04c-18bef09141d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:41.592871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834917-a73d-4655-b04c-18bef09141d2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.593158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834917-a73d-4655-b04c-18bef09141d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.593436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834917-a73d-4655-b04c-18bef09141d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.604874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66834917-a73d-4655-b04c-18bef09141d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-66834917-a73d-4655-b04c-18bef09141d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:41.612676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:41.613562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:41.614353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 138/282] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:41.621495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:41.693094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205285b9-e336-4c1d-850d-58ddfae7818a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.693428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205285b9-e336-4c1d-850d-58ddfae7818a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.693659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205285b9-e336-4c1d-850d-58ddfae7818a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.695315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 139/283] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:41.700494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.700784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.701068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.718313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:41.719544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:41.746038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391f07c-2d67-482a-a400-2dd3404a97cd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:41.788023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:41.788715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:41.789055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:41.789275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:41.790027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:41.790337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:41.795467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:41.799433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:41.811328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 140/284] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:41.813143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 145/285] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:41.818697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:41.841557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:41.964195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8286e-b2f6-465b-bcc1-6032f2e34648 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:41.990388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:42.004992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.006145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.006659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.007137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.022341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:42.040070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:42.040986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:42.042351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:42.046953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 146/286] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:42.050912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92edc2-cf7e-4411-b4a1-09e72cb96b0b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:42.053777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:42.120506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.125742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.126259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.126734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] PATH_INFO: `/v3/users/5b706ef18ec24400b1f967086327be51` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.128325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] RBAC: Authorizing `identity:get_user(user_id=5b706ef18ec24400b1f967086327be51)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:42.130040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:42.132059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 141/287] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:41 2022] GET /identity/v3/users/5b706ef18ec24400b1f967086327be51 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:42.139289 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:42.165451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:42.253494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b24fc1-a1c5-4c61-ada9-9f4c62f4ea96 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:42.306024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d177-0f32-4e48-a197-0753448813dc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:42.328369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.329045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.329332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.329608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.330358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:42.330666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:42.332083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:42.351216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 147/288] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:42.356590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:42.377740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.378616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.378892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.379164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.381768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:42.383242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:42.385864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 142/289] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:42 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:42.397515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:42.428123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:42.544318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f09ed7-e4eb-45ca-a8a5-27326f83a68c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:42.552949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e8bde-a390-4f64-a6bf-056f0c131dd9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:42.562755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:42.596005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.596920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.597204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.597479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c/users/5b706ef18ec24400b1f967086327be51/roles/87acdb843de948ef942863f1665147cb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.600164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] RBAC: Authorizing `identity:create_grant(project_id=797ec60568f642e891fad08f02650c2c, user_id=5b706ef18ec24400b1f967086327be51, role_id=87acdb843de948ef942863f1665147cb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:42.601649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:42.604978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.605874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.606156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.606428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] PATH_INFO: `/v3/users/2112146a059f4106817517c17ab6b4bb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.607649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] RBAC: Authorizing `identity:get_user(user_id=2112146a059f4106817517c17ab6b4bb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:42.609216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:42.610856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 148/290] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:42 2022] GET /identity/v3/users/2112146a059f4106817517c17ab6b4bb => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:42.616374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:42.638837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 143/291] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:50:42 2022] PUT /identity/v3/projects/797ec60568f642e891fad08f02650c2c/users/5b706ef18ec24400b1f967086327be51/roles/87acdb843de948ef942863f1665147cb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:42.740927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dd64a-7c66-46ea-957d-f77138d8e902 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:42.785962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:42.786637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:42.786926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:42.787203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:42.847829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:42.864017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:42.866041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:43.021625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 149/292] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:43.026920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:43.120781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:43.156175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473176-4aa1-415e-bfe5-05a9db89d140 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:43.210345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe749d7-7bdd-4ebd-8acd-3fb29f28f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:43.211579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe749d7-7bdd-4ebd-8acd-3fb29f28f364 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:43.212083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe749d7-7bdd-4ebd-8acd-3fb29f28f364 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:43.212575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe749d7-7bdd-4ebd-8acd-3fb29f28f364 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:43.214031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe749d7-7bdd-4ebd-8acd-3fb29f28f364 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:43.215685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe749d7-7bdd-4ebd-8acd-3fb29f28f364 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:43.217638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 144/293] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:43 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:43.223709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:43.342576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:43.361021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8cdbf-bcbc-4a24-9641-9a6c4fc9492e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:43.413797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:43.414410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:43.414695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:43.414970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:43.415869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=2112146a059f4106817517c17ab6b4bb) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:43.416186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:43.418362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27be2d-6042-4ae6-8b00-68dac3167c4a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:43.429469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 150/294] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:43 2022] GET /identity/v3/role_assignments?user.id=2112146a059f4106817517c17ab6b4bb&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=2dc775396d5544848b5553a1e7bf708b => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:43.852654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c810-3215-45ee-8841-2d7de25b7163 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:43.853167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c810-3215-45ee-8841-2d7de25b7163 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:43.853242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c810-3215-45ee-8841-2d7de25b7163 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:43.854887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 145/295] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:43.860475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:43.860765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:43.861041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:43.878351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:43.879544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:43.893630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1273e75-4206-43a2-ba4f-29a33cc33ed3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:43.893915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1273e75-4206-43a2-ba4f-29a33cc33ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:43.894189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1273e75-4206-43a2-ba4f-29a33cc33ed3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:43.896272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 146/296] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:43.908065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:43.908481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:43.908866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:43.928627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:43.930001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:43.969815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 151/297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:43.996503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.022849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 147/298] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:44.046554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.103695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.127098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.130705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f7f94-6b44-4653-9a6b-9a4c5f317977 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.158328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3efef-941f-4a3e-8900-d3fb8a4798a6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.171850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5625b-d952-41bf-acc7-97698b49e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.172668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5625b-d952-41bf-acc7-97698b49e300 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.172950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5625b-d952-41bf-acc7-97698b49e300 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.173225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5625b-d952-41bf-acc7-97698b49e300 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.184864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5625b-d952-41bf-acc7-97698b49e300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-69c5625b-d952-41bf-acc7-97698b49e300 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:44.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:44.193886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:44.194681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 152/299] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:44.195928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e2d-8ab0-4fe6-a7c4-c3f21982024b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.195928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e2d-8ab0-4fe6-a7c4-c3f21982024b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.196096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e2d-8ab0-4fe6-a7c4-c3f21982024b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.197486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 153/300] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:44.201136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e2d-8ab0-4fe6-a7c4-c3f21982024b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.202108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e9f2a-4ae6-4114-9ed9-a4731d0d2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.202916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e9f2a-4ae6-4114-9ed9-a4731d0d2048 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.203196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e9f2a-4ae6-4114-9ed9-a4731d0d2048 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.203468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e9f2a-4ae6-4114-9ed9-a4731d0d2048 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.215433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e9f2a-4ae6-4114-9ed9-a4731d0d2048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-386e9f2a-4ae6-4114-9ed9-a4731d0d2048 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:44.223804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:44.224747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:44.225532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:44.228041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 148/301] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:44.230106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.230392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.230673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.247276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:44.248515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:44.313818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e2d-8ab0-4fe6-a7c4-c3f21982024b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.321176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 149/302] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:44.322133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.370312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.370905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.371184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.371455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.372233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:44.372547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.373969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.382956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 154/303] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:44.386838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.388712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.391575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.429844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d8801-594b-456e-9f6a-aac72b7ab7d0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.465714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.466395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.466682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.466957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.467714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:44.468054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.469428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.481099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 150/304] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:44.481825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.496096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d7fb8-f593-4a74-82e4-9270eb5784f3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.530491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.531289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.531572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.531879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.533048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.534518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.536315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 155/305] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:44.536919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.592738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e4561-932a-4149-b8ec-fb701d75373d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.611085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.622027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.633787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.634670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.634959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.635740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] PATH_INFO: `/v3/users/b3aee6ff441140a59b6ee06e883b59f0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.636984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] RBAC: Authorizing `identity:get_user(user_id=b3aee6ff441140a59b6ee06e883b59f0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.638453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.640127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 151/306] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/users/b3aee6ff441140a59b6ee06e883b59f0 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:44.640868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.650144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f1990-5cec-4d69-8fd2-84841a67701a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.687446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.688374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.688648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.688923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] PATH_INFO: `/v3/users/656185ae48a449ad9ef4b8de396cdf45` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.703374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] RBAC: Authorizing `identity:get_user(user_id=656185ae48a449ad9ef4b8de396cdf45)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.704918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.706792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 156/307] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/users/656185ae48a449ad9ef4b8de396cdf45 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:44.711964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.752150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e02e-b48d-46c8-86e0-088fb74a9997 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.790696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.791482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.791637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.791937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] PATH_INFO: `/v3/groups` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.792621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.794063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.810588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 152/308] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Jun 3 08:50:44 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:44.816804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:44.827296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c943d9-90bc-402d-8f6a-472ef949b8fd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:44.862606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.876602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940637f-8e56-4ac6-a305-db33becbe265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:44.877581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940637f-8e56-4ac6-a305-db33becbe265 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:44.877963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940637f-8e56-4ac6-a305-db33becbe265 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:44.878759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940637f-8e56-4ac6-a305-db33becbe265 None admin] PATH_INFO: `/v3/system/users/b3aee6ff441140a59b6ee06e883b59f0/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:44.882971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940637f-8e56-4ac6-a305-db33becbe265 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b3aee6ff441140a59b6ee06e883b59f0, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:44.884647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940637f-8e56-4ac6-a305-db33becbe265 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:44.897571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 157/309] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Jun 3 08:50:44 2022] PUT /identity/v3/system/users/b3aee6ff441140a59b6ee06e883b59f0/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:44.911363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:44.972489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105c2c-31a8-4ce2-b371-89b18176509b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:45.017695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:45.018399 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:45.018686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:45.018965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:45.019856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] RBAC: Adding query filter params (role.id=87acdb843de948ef942863f1665147cb, user.id=656185ae48a449ad9ef4b8de396cdf45, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:45.020178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:45.021701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7154b-954b-4292-a4d0-4c3b589c7997 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:45.028417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 153/310] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 08:50:44 2022] GET /identity/v3/role_assignments?user.id=656185ae48a449ad9ef4b8de396cdf45&scope.system=all&role.id=87acdb843de948ef942863f1665147cb => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:45.331328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cec307-8d15-4376-83dd-47958dab449d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:45.331768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cec307-8d15-4376-83dd-47958dab449d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:45.332145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cec307-8d15-4376-83dd-47958dab449d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:45.333617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 158/311] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:45.339901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:45.340281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:45.340624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:45.357755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:45.358950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:45.430098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 154/312] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:45.453620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cec307-8d15-4376-83dd-47958dab449d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:45.566635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cec307-8d15-4376-83dd-47958dab449d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:45.601733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:45.602455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:45.602735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:45.603006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:45.614122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:45.622360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:45.623246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:45.624079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 159/313] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:45.629278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:45.678596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:45.736702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70905-c969-4a5c-96e5-3ffde77f9adc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:45.775320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:45.776870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:45.777365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:45.777817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:45.778770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:45.779265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:45.780904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:45.790439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 155/314] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:45.796737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:45.852342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:45.908524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5d02-aedc-4b4c-82df-885959a0a520 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:45.944618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:45.945497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:45.945776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:45.946046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] PATH_INFO: `/v3/users/5b706ef18ec24400b1f967086327be51` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:45.947242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] RBAC: Authorizing `identity:get_user(user_id=5b706ef18ec24400b1f967086327be51)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:45.948775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:45.950708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 160/315] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:45 2022] GET /identity/v3/users/5b706ef18ec24400b1f967086327be51 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:45.955996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:46.081604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6fcc-355a-40e5-908b-b01388de7a16 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:46.092395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:46.122792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:46.123523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:46.123937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:46.124317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:46.200361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:46.202042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:46.312038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 156/316] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:46.317432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:46.425794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8ecc-cf02-45c4-9c1e-b666560c42f7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:46.446259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:46.461419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c251c4-e49b-4679-bfbf-44693234fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:46.462288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c251c4-e49b-4679-bfbf-44693234fd18 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:46.462573 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c251c4-e49b-4679-bfbf-44693234fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:46.462849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c251c4-e49b-4679-bfbf-44693234fd18 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:46.464109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c251c4-e49b-4679-bfbf-44693234fd18 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:46.465575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c251c4-e49b-4679-bfbf-44693234fd18 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:46.467574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 161/317] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:46 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:46.473260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:46.504081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:46.574557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32bca-46c3-4353-a406-b65526ba834b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:46.608653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:46.609309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:46.609586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:46.609852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:46.610675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] RBAC: Adding query filter params (role.id=87acdb843de948ef942863f1665147cb, scope.project.id=797ec60568f642e891fad08f02650c2c, user.id=5b706ef18ec24400b1f967086327be51) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:46.610979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:46.612455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ce6ee-f98f-41fe-b987-646f62850301 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:46.618766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 157/318] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:50:46 2022] GET /identity/v3/role_assignments?user.id=5b706ef18ec24400b1f967086327be51&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=87acdb843de948ef942863f1665147cb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:47.289054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5dd7f-9c86-4749-8fbf-77a17234687f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.289424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5dd7f-9c86-4749-8fbf-77a17234687f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.289605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5dd7f-9c86-4749-8fbf-77a17234687f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.291026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 162/319] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:47.296545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.297013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.297086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.297153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f93f6-434c-49d1-8a00-d70fd760ff0c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.297476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f93f6-434c-49d1-8a00-d70fd760ff0c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.297677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f93f6-434c-49d1-8a00-d70fd760ff0c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.299125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 163/320] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:47.304628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.304916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.305185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.316706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:47.318175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:47.322414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:47.324185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:47.394673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 158/321] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:47.395878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 164/322] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:47.417373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.417625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.419995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:47.520951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1d4e1-aa42-4ebb-bc2c-5f2274ded6f8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:47.521307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801eba5-82a2-48b5-88b5-2d03461ee527 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:47.538258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:47.555126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbf793-4cb0-44ec-9ba4-c44f126d4a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:47.555892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf793-4cb0-44ec-9ba4-c44f126d4a6a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.555999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0221-9c39-4ac1-94d6-f9424fcc1f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:47.556172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf793-4cb0-44ec-9ba4-c44f126d4a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.556442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbf793-4cb0-44ec-9ba4-c44f126d4a6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.556752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0221-9c39-4ac1-94d6-f9424fcc1f6f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.557058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0221-9c39-4ac1-94d6-f9424fcc1f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.557856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0221-9c39-4ac1-94d6-f9424fcc1f6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.558191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbf793-4cb0-44ec-9ba4-c44f126d4a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:47.559638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbf793-4cb0-44ec-9ba4-c44f126d4a6a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:47.561279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 159/323] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:47.562531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11582e7f-b550-4c75-ae0b-85d6ff0c099b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.562817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11582e7f-b550-4c75-ae0b-85d6ff0c099b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.563090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11582e7f-b550-4c75-ae0b-85d6ff0c099b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.564489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 160/324] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:47.568208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0221-9c39-4ac1-94d6-f9424fcc1f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:47.568673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11582e7f-b550-4c75-ae0b-85d6ff0c099b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-a4df0221-9c39-4ac1-94d6-f9424fcc1f6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:47.575955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:47.577056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:47.577864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 165/325] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:47.578506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33381261-6d29-4587-9204-8268f1d5702e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.578579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33381261-6d29-4587-9204-8268f1d5702e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.579418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33381261-6d29-4587-9204-8268f1d5702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.595017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-33381261-6d29-4587-9204-8268f1d5702e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:47.596222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-33381261-6d29-4587-9204-8268f1d5702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:47.641769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:47.663719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 166/326] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:47.664629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33381261-6d29-4587-9204-8268f1d5702e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.677723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11582e7f-b550-4c75-ae0b-85d6ff0c099b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:47.713687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:47.714350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.714635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.714908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] PATH_INFO: `/v3/groups` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.715592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:47.717089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:47.730601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 161/327] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Jun 3 08:50:47 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:50:47.731416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.778756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33381261-6d29-4587-9204-8268f1d5702e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:47.789756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:47.819748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:47.820844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.821303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.821751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.822901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:47.823414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:47.825238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:47.835612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 167/328] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:47.841312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.856462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59381339-6d1b-485b-92d9-0335a7be6605 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:47.893336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:47.901856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:47.902676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:47.902959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:47.903231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:47.919096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:47.927243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:47.928182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:47.929431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 162/329] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:47.935616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:47.972188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39f5f-45fb-466f-bf29-f978f7c8678b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:48.019671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:48.020973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:48.021079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:48.021292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] PATH_INFO: `/v3/users/b3aee6ff441140a59b6ee06e883b59f0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:48.022885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] RBAC: Authorizing `identity:get_user(user_id=b3aee6ff441140a59b6ee06e883b59f0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:48.025899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:48.027126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 168/330] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:47 2022] GET /identity/v3/users/b3aee6ff441140a59b6ee06e883b59f0 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:48.035445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:48.079224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c0bd-eae3-42db-b05b-c535408ab14b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:48.083921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:48.123920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:48.124757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:48.125087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:48.125368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:48.126125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:48.126433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:48.127864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:48.139439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 163/331] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:48.147078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:48.173751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f6559-0d7b-4cc2-bd80-ecee5d90da6d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:48.217094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:48.226098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:48.226776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:48.227087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:48.227332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:48.228199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] RBAC: Adding query filter params (role.id=2dc775396d5544848b5553a1e7bf708b, user.id=b3aee6ff441140a59b6ee06e883b59f0, scope.system=all) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:48.228517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:48.230032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:48.247104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 169/332] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 08:50:48 2022] GET /identity/v3/role_assignments?user.id=b3aee6ff441140a59b6ee06e883b59f0&scope.system=all&role.id=2dc775396d5544848b5553a1e7bf708b => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:48.298771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c15de-10af-4faa-9bd0-86d1d1489fd9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:48.340432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9f57c-42e8-42b9-935c-0b6770c47dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:48.341311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9f57c-42e8-42b9-935c-0b6770c47dbb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:48.341599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9f57c-42e8-42b9-935c-0b6770c47dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:48.341873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9f57c-42e8-42b9-935c-0b6770c47dbb None admin] PATH_INFO: `/v3/users/656185ae48a449ad9ef4b8de396cdf45` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:48.343185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9f57c-42e8-42b9-935c-0b6770c47dbb None admin] RBAC: Authorizing `identity:get_user(user_id=656185ae48a449ad9ef4b8de396cdf45)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:48.344780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9f57c-42e8-42b9-935c-0b6770c47dbb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:48.346815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 164/333] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:48 2022] GET /identity/v3/users/656185ae48a449ad9ef4b8de396cdf45 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:48.352615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:48.468333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:48.476239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c15ac-e8be-4301-a528-2757053328ba None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:48.524806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea628-3b05-4536-aa2e-416fda006153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:48.526588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea628-3b05-4536-aa2e-416fda006153 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:48.527038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea628-3b05-4536-aa2e-416fda006153 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:48.527380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea628-3b05-4536-aa2e-416fda006153 None admin] PATH_INFO: `/v3/system/users/656185ae48a449ad9ef4b8de396cdf45/roles/87acdb843de948ef942863f1665147cb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:48.529079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea628-3b05-4536-aa2e-416fda006153 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=656185ae48a449ad9ef4b8de396cdf45, role_id=87acdb843de948ef942863f1665147cb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:48.530485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea628-3b05-4536-aa2e-416fda006153 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:48.539022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 170/334] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Jun 3 08:50:48 2022] PUT /identity/v3/system/users/656185ae48a449ad9ef4b8de396cdf45/roles/87acdb843de948ef942863f1665147cb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:50.830322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722897c9-3b93-48e2-b0c0-1203636196e2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:50.831378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722897c9-3b93-48e2-b0c0-1203636196e2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:50.831953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722897c9-3b93-48e2-b0c0-1203636196e2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:50.833974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 165/335] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:50.844792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0208-0eb4-4417-8ea2-607641f1482a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:50.845783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0208-0eb4-4417-8ea2-607641f1482a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:50.846283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0208-0eb4-4417-8ea2-607641f1482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:50.866177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9cae0208-0eb4-4417-8ea2-607641f1482a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:50.867705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9cae0208-0eb4-4417-8ea2-607641f1482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:50.941912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1e77-4b28-4d09-b967-d6783039efa5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:50.942550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1e77-4b28-4d09-b967-d6783039efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:50.943038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1e77-4b28-4d09-b967-d6783039efa5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:50.944740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 166/336] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:50.952328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469644-3c5c-4c09-9219-c1406eab31e3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:50.952599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469644-3c5c-4c09-9219-c1406eab31e3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:50.953154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469644-3c5c-4c09-9219-c1406eab31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:50.958401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 171/337] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:50.992899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8b469644-3c5c-4c09-9219-c1406eab31e3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:50.994116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8b469644-3c5c-4c09-9219-c1406eab31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:51.029120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a3af1-ec97-4b48-aa33-79c409381f06 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.029757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a3af1-ec97-4b48-aa33-79c409381f06 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.030253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a3af1-ec97-4b48-aa33-79c409381f06 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.032475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 172/338] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:51.033395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a3af1-ec97-4b48-aa33-79c409381f06 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.086493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 167/339] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:51.087924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.088304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.088582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.119975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:51.121296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:51.199325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:51.220142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:51.238153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a3af1-ec97-4b48-aa33-79c409381f06 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:51.239871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 168/340] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:51.240904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.287368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:51.288578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.289021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.289429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.302240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:51.311262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:51.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:51.313654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:51.316143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 173/341] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:51.317247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.384355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd106a-b243-4833-bed7-ff87ec6bcbca None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:51.421854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:51.422945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.423228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.423504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.438053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:51.439033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba379-7222-4bd4-b6e5-8e54f017a3e7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:51.450905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:51.452315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:51.453095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 169/342] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:51.453765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.491951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:51.493125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.493620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.494089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.506235 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:51.513914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:51.514768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:51.515650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:51.516505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:51.518864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 174/343] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:51.523258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.546477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:51.591486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d885c-3076-4526-9b01-41ddc38b7bfa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:51.629507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:51.631001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.631634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.632142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.633285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:51.633817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:51.635514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:51.646717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 170/344] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:51.647894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.763358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a265-28e9-48c7-b050-0359addc578e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:51.767075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aca0fc-91b8-4deb-843f-c1ed962c1646 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:51.776223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:51.816006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:51.816703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.817053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.817259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.818020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:51.818333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:51.819747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:51.837692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 171/345] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:51.839092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:51.863918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:51.864622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:51.865082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:51.865373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:51.866154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:51.866440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:51.867888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:51.889794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 175/346] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:51.890417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:52.004452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.058026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013713-14e7-468f-8538-3f07a123e148 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:52.103407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398676-df46-4796-9ac4-5dc92338a260 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:52.134447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:52.136034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.136523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.136986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.177906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc284725-f203-46dd-802a-9aeda0b606a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:52.178992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc284725-f203-46dd-802a-9aeda0b606a8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.180450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc284725-f203-46dd-802a-9aeda0b606a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.183775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc284725-f203-46dd-802a-9aeda0b606a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.243014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.280584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:52.282060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:52.310831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc284725-f203-46dd-802a-9aeda0b606a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:52.312572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc284725-f203-46dd-802a-9aeda0b606a8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:52.406907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.443341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 176/347] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:52.444244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:52.462275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 172/348] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:52.462490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef734-5355-4e66-a361-7158ed27f41d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.462623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef734-5355-4e66-a361-7158ed27f41d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.462904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef734-5355-4e66-a361-7158ed27f41d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.464669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 173/349] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:52.469096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743278bd-abce-4639-a444-ab50dd251c9e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.469096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743278bd-abce-4639-a444-ab50dd251c9e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.469096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743278bd-abce-4639-a444-ab50dd251c9e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.469096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 174/350] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:52.469096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743278bd-abce-4639-a444-ab50dd251c9e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:52.565882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.585426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63b21-59e1-4d93-9334-6192808457ac None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:52.614457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743278bd-abce-4639-a444-ab50dd251c9e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:52.627667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d27712-81fe-460b-bed6-021601feaa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:52.628424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27712-81fe-460b-bed6-021601feaa08 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.628715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27712-81fe-460b-bed6-021601feaa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.628988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d27712-81fe-460b-bed6-021601feaa08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.656584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:52.658224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.658720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.658999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.660948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:52.661825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:52.667846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 175/351] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:52 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:52.667846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:52.680076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.712772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d27712-81fe-460b-bed6-021601feaa08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:52.714495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d27712-81fe-460b-bed6-021601feaa08 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:52.787424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d7e2-702c-4a73-a7ff-e4916e634fd6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:52.826313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.833678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 177/352] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:52.833840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39322126-a893-4b88-a2a5-d1d1b2a6c831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:52.833840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39322126-a893-4b88-a2a5-d1d1b2a6c831 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.834158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39322126-a893-4b88-a2a5-d1d1b2a6c831 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.834253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.834325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39322126-a893-4b88-a2a5-d1d1b2a6c831 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.834392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.835826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.835953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39322126-a893-4b88-a2a5-d1d1b2a6c831 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:52.837258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39322126-a893-4b88-a2a5-d1d1b2a6c831 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:52.839221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 176/353] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:52 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:52.840396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea13e-e984-4f57-9c0a-2823732895a2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.840679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea13e-e984-4f57-9c0a-2823732895a2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.843135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ea13e-e984-4f57-9c0a-2823732895a2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.847872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 177/354] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:52.849163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:52.849446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:52.849721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:52.851848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:52.853060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:52.872367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:52.873571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:52.938197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 178/355] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:52.940147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:52.942525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:52.968447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 178/356] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:52.969234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.077109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dcd62-a226-4055-806c-24a8aebee7b7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.086414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed12670-cd36-4f81-b0a8-1c7228d45fa1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.121337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:53.125919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac769fa-8bfc-469e-8db7-e80f673461c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.126792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac769fa-8bfc-469e-8db7-e80f673461c3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.127078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac769fa-8bfc-469e-8db7-e80f673461c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.127357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac769fa-8bfc-469e-8db7-e80f673461c3 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.128681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.129523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.129802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.130072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.131256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:53.132743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:53.134443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 179/357] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:52 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:53.135236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.135353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac769fa-8bfc-469e-8db7-e80f673461c3 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:53.136805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac769fa-8bfc-469e-8db7-e80f673461c3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:53.138509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 179/358] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:52 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:53.139714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.140074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.141058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.159258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:53.160485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:53.228522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:53.238249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 180/359] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:53.239187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.273378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305148-b3d5-4fa1-b55b-f00e9f683b82 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.315456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.316367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.316652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.316931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.318123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:53.319574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:53.321283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 180/360] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:53.322055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.369420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12db731-c867-4219-bc3d-8c7abfd66a0a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.398491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:53.409576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.410391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.410669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.411403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.428164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:53.436370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:53.437524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:53.438375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 181/361] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:53.439055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.446827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244e91-ffe2-4ede-9f29-42a5d602f523 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.491069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.491856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.492847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.492847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.505703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:53.508851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:53.513886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:53.514805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:53.515605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 181/362] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:53.516404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.561544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a751d54-8652-4907-8849-b8ad24cf21d6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.600155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.601036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.601318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.601734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.603441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:53.605467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:53.607125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 182/363] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:53.607938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.641513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81864a-f381-40c5-a567-60ee54f74b64 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.672915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:53.683381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.684074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.684359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.684636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.685470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=e304ec690b354614bc483c8980edbb91) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:53.685785 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:53.687238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:53.693929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 182/364] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=2dc775396d5544848b5553a1e7bf708b => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:53.694663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.733819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6556-5602-4f38-9df6-6f8acdfda354 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.763152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:53.779090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.779090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.779360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.781261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.794307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:53.802863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:53.804017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:53.804821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 183/365] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:53.805493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.828991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643bff1-40ac-4403-98e4-b54b4343cb90 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.872157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:53.872824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:53.873100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:53.873378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:53.874226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=797ec60568f642e891fad08f02650c2c) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:53.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:53.876068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:53.891810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 183/366] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=2dc775396d5544848b5553a1e7bf708b => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:53.891810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:53.944388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf666a8-f3a9-4d0f-8b7f-1d445eea0fb4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:53.971362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.000517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.002205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.002682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.003104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.004666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:54.005154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.007588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.020318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 184/367] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:54.021510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.043203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3c69-ef06-43a0-8123-b1d7f604153b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.078071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.087324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.088571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.089153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.089634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.090628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:54.091140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.092969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.102889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 184/368] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:54.104160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.141771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0f4b3-e41b-4eb2-bd21-65d940ecc57e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.177578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.178436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.178816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.179306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.180250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=e304ec690b354614bc483c8980edbb91) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:54.180627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.182662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.195907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 185/369] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:54.201321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.239015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31184728-3160-4cc5-a949-edd1fd1d95ad None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.277501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.340990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.341677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.341959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.342234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.342987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:54.343296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.344724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.363275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 185/370] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:54.364198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.377382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa99d-a634-4aae-9d15-7a7be6da1c2d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.389602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.418498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.419787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.420289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.420921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] PATH_INFO: `/v3/users/656185ae48a449ad9ef4b8de396cdf45` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.422472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] RBAC: Authorizing `identity:get_user(user_id=656185ae48a449ad9ef4b8de396cdf45)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.424442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.426682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 186/371] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/users/656185ae48a449ad9ef4b8de396cdf45 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:54.427785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.544084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea830b-44dd-4707-b40a-a9a81eabcf6f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.563154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865a5e-c9a2-4b94-8b87-806c93ef1f76 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.588674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.589981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.590349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.590697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.628208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.629258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.629602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.629970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.661960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.687065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.688930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.731596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.781334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.782745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.795509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 187/372] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:54.796781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.880405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:54.905220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56732c3d-46e6-4519-bc49-463804bb7a5d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:54.943954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:54.945019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:54.946093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:54.946580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:54.947665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] RBAC: Adding query filter params (role.id=87acdb843de948ef942863f1665147cb, user.id=656185ae48a449ad9ef4b8de396cdf45, scope.system=all) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:54.948289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:54.950752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:54.969788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 188/373] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/role_assignments?user.id=656185ae48a449ad9ef4b8de396cdf45&scope.system=all&role.id=87acdb843de948ef942863f1665147cb => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:54.970988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:54.996447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 186/374] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:50:55.002026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:55.098400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce7d1c-8a9c-4e1d-9a62-63cd7d38834e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:55.136240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:55.138031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:55.138516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:55.138990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:55.140557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:55.142481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:55.144615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 189/375] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:54 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:55.152765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:55.157744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:55.163872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:55.207022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e97a7-90b0-40fe-b19b-7438dc00a715 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:55.268561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:55.269383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:55.269674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:55.270014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] PATH_INFO: `/v3/projects/f8d8a528e88945da98e9389d0fe7141f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:55.271211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] RBAC: Authorizing `identity:get_project(project_id=f8d8a528e88945da98e9389d0fe7141f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:55.272557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054acda-691a-4086-a2ca-0fb8a6092dda None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:55.272749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:55.274829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 187/376] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:55 2022] GET /identity/v3/projects/f8d8a528e88945da98e9389d0fe7141f => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:55.281074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:55.313713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:55.315015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:55.315497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:55.316001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:55.317527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:55.319519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:55.321807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 190/377] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:55 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:55.335614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:55.408999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05729e0d-3731-4b86-acce-53390df9c7cd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:55.424486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:55.453892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:55.454728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:55.455011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:55.455286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] PATH_INFO: `/v3/groups/96b0315da82246a893bcddbcb209368a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:55.461035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c649d-bff5-405c-b10f-77c94ad2a729 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:55.468501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] RBAC: Authorizing `identity:get_group(group_id=96b0315da82246a893bcddbcb209368a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:55.470003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:55.472089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 188/378] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:55 2022] GET /identity/v3/groups/96b0315da82246a893bcddbcb209368a => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:55.477841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:55.500527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:55.501839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:55.502772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:55.503322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:55.503869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:55.504922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=797ec60568f642e891fad08f02650c2c) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:55.505415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:55.507114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebadca-0f65-4519-b06e-d6be4e9f3577 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:55.514488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 191/379] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:50:55 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:55.630734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed53e5-baa8-4506-9ede-aca94257c9ad None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:55.673666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:55.674262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:55.674548 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:55.674828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:55.675675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] RBAC: Adding query filter params (group.id=96b0315da82246a893bcddbcb209368a, role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=f8d8a528e88945da98e9389d0fe7141f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:55.676015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:55.677723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873ecef-de3d-48c1-873f-f635f04d0dc7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:55.688225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 189/380] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:50:55 2022] GET /identity/v3/role_assignments?group.id=96b0315da82246a893bcddbcb209368a&scope.project.id=f8d8a528e88945da98e9389d0fe7141f&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:56.312615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b08a2-cb34-4248-995b-fb32270b8bc8 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:56.313306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b08a2-cb34-4248-995b-fb32270b8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:56.313695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b08a2-cb34-4248-995b-fb32270b8bc8 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:56.315587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 192/381] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:56.321228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:56.321832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:56.321832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:56.342955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:56.344211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:56.441375 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 190/382] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:56.478301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b08a2-cb34-4248-995b-fb32270b8bc8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:56.596883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b08a2-cb34-4248-995b-fb32270b8bc8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:56.633340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:56.634149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:56.634434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:56.634707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:56.637604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:56.647536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:56.655881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:56.657476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:56.659025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:56.665285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 193/383] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:50:56.672006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:56.675456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:56.800213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c54a9d-bd04-4350-b1b4-6c8852034776 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:56.841796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:56.842834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:56.843306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:56.843783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:56.844722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:56.845239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:56.846816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ee169-f6b5-4e72-a58e-8c4fc2745634 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:56.860157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 191/384] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:56.866510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:56.895344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45995-808b-40ad-aafa-94e5ec8fed78 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:56.896097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45995-808b-40ad-aafa-94e5ec8fed78 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:56.896563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45995-808b-40ad-aafa-94e5ec8fed78 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:56.898126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 192/385] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:56.909693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:56.910282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:56.910771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:56.937308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:56.938856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:56.995311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a426-72ec-4fea-b78b-990d1768961b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.034101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.036295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.036578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.036856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.038352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:57.042226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:57.045103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 194/386] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:56 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:57.052672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.081591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:57.097754 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 193/387] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:50:57.128295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.159013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:57.230858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525824-eaf6-4791-855b-2e2820d3fa86 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.281426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672715-8912-4010-969a-44301c2f82d8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.310642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.311519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.311824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.312098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.314525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:57.316759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:57.326195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 195/388] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:57.329018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.336181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d11f-f5bf-4f36-bf07-a449329f1f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.336994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d11f-f5bf-4f36-bf07-a449329f1f0f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.337277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d11f-f5bf-4f36-bf07-a449329f1f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.337550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d11f-f5bf-4f36-bf07-a449329f1f0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.361286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d11f-f5bf-4f36-bf07-a449329f1f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5a24d11f-f5bf-4f36-bf07-a449329f1f0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:57.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:57.369960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:57.370758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 194/389] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:57.375990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775bafd-3cbd-479c-af4c-3a883c0e6673 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.376337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775bafd-3cbd-479c-af4c-3a883c0e6673 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.376651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775bafd-3cbd-479c-af4c-3a883c0e6673 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.378516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 195/390] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:57.384108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775bafd-3cbd-479c-af4c-3a883c0e6673 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.445833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:57.453164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde05c14-039d-4d3d-9d1d-9172c809fc29 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.486262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:57.492408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0254-3744-43f1-a580-a102feb60144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.493308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0254-3744-43f1-a580-a102feb60144 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.493590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0254-3744-43f1-a580-a102feb60144 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.493922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0254-3744-43f1-a580-a102feb60144 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.496034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0254-3744-43f1-a580-a102feb60144 None admin] RBAC: Authorizing `identity:create_grant(project_id=e304ec690b354614bc483c8980edbb91, group_id=df8778a2fa954dd8b1d4fdf7470c8360, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:57.497694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0254-3744-43f1-a580-a102feb60144 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:57.497951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775bafd-3cbd-479c-af4c-3a883c0e6673 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.513688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 196/391] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 08:50:57 2022] PUT /identity/v3/projects/e304ec690b354614bc483c8980edbb91/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 08:50:57.515029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.515321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.515593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.558506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.559295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.559582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.559889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.560702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:57.560936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:57.561116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:57.562162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:57.562484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:57.575283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 196/392] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:57.584898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.689282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 197/393] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:57.711661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662c0b-e6be-42a6-bed7-40cb45099c38 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.725201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.777429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.778477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.779365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.779478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.780472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:57.782297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:57.783962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:57.786251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 197/394] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:57.792731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.872080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15fb6-b998-4616-9f54-516d0529d6ab None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.902624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:57.911129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f5f8-6d30-4f86-8cf6-ddf70e165917 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:57.918628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.919626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.920089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.920496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.935129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:57.943990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:57.944946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:57.945730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 198/395] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:57.955453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:57.986889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:57.986889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:57.986889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:57.986889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:57.988269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:57.995811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:57.995811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 198/396] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:50:57.999560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:58.095438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:58.147181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc853-05d9-4bbf-a5c2-5d2d5aa2f23c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:58.151731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b154-4e75-4272-923f-2fbb0cd71244 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:58.191064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b25f-562a-493b-887f-976a2901279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:58.192439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b25f-562a-493b-887f-976a2901279c None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.193035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b25f-562a-493b-887f-976a2901279c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.193573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b25f-562a-493b-887f-976a2901279c None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.196096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730b25f-562a-493b-887f-976a2901279c None admin] RBAC: Authorizing `identity:create_grant(project_id=797ec60568f642e891fad08f02650c2c, group_id=df8778a2fa954dd8b1d4fdf7470c8360, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:58.196808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:58.198032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.198323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.198603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.199188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730b25f-562a-493b-887f-976a2901279c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:58.199359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:58.199669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:58.201078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:58.215819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 199/397] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 08:50:57 2022] PUT /identity/v3/projects/797ec60568f642e891fad08f02650c2c/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:50:58.221067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 199/398] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:58.222954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b25f-562a-493b-887f-976a2901279c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:58.351450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b25f-562a-493b-887f-976a2901279c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:58.368923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:58.395376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:58.396636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.397118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.397622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.399121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:58.401487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:58.407893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 200/399] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:58 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:58.412982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:58.496092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:58.563346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3811-2dc1-434a-883d-b8d250cb2511 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:58.606351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bf93-df96-4302-99c7-4296c08d1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:58.607228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bf93-df96-4302-99c7-4296c08d1338 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.607513 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bf93-df96-4302-99c7-4296c08d1338 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.607819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bf93-df96-4302-99c7-4296c08d1338 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.609050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8bf93-df96-4302-99c7-4296c08d1338 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:58.610649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8bf93-df96-4302-99c7-4296c08d1338 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:58.612709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 200/400] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:58 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:58.618505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:58.731678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde33a33-0926-434e-bdff-3d2b5a9f551f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:58.769293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249600c-8581-4f4c-b749-91ee23390e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:58.770111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249600c-8581-4f4c-b749-91ee23390e5e None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.770389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249600c-8581-4f4c-b749-91ee23390e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.770661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249600c-8581-4f4c-b749-91ee23390e5e None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.773251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249600c-8581-4f4c-b749-91ee23390e5e None admin] RBAC: Authorizing `identity:create_grant(project_id=e304ec690b354614bc483c8980edbb91, group_id=df8778a2fa954dd8b1d4fdf7470c8360, role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:58.774089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466c8d-fda3-4474-ac65-4655a383df75 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.774379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466c8d-fda3-4474-ac65-4655a383df75 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.774662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466c8d-fda3-4474-ac65-4655a383df75 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.774763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249600c-8581-4f4c-b749-91ee23390e5e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:58.777195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 201/401] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:50:58.785387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.785863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.786303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.799464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 201/402] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 08:50:58 2022] PUT /identity/v3/projects/e304ec690b354614bc483c8980edbb91/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 08:50:58.816468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da0ed3-a3b0-404c-8abe-a05403453418 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.817018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da0ed3-a3b0-404c-8abe-a05403453418 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.817436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da0ed3-a3b0-404c-8abe-a05403453418 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.819017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 202/403] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:50:58.829343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:58.830026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:58.830320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:58.830599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:58.831283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:58.860054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:50:58.861325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:50:58.914915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 202/404] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:50:58.942134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:58.960302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:59.014963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:59.038278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 203/405] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 03 08:50:59.073765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.096462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012f49c-2879-42c3-95b6-eda43edf4fd1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.140300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.141454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.141987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.142488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.154114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:59.162115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:59.163003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:50:59.163822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:50:59.167093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 203/406] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:59.172848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.254911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc51a64-28fc-4e8e-88be-d51b0f78658e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.293892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.294641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.294984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.295278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.320966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:50:59.327886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7fe02-1c4b-4106-b044-3a34fc0ed8c5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.329646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:50:59.340094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:50:59.341040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:50:59.341808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:50:59.342896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 204/407] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:50:59.348879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.404104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:59.408462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.409155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.409440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.409717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.410481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:59.410795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:59.412236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:59.438043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 204/408] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:59.444723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.460400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ddc9-9232-4f1a-a8b7-5742240eb3d8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.496217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.496903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.497184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.497454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.498201 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:50:59.498506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:59.499951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:59.508841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 205/409] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:59.516826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.648856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a3ca1-80ea-4a5a-846a-3f4d4283bad6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.668158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:59.683935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910c04-b16b-49f8-9722-2655103b1b76 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.699534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.700868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.701360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.701963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] PATH_INFO: `/v3/groups/96b0315da82246a893bcddbcb209368a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.705339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] RBAC: Authorizing `identity:get_group(group_id=96b0315da82246a893bcddbcb209368a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:59.707304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:59.710287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 205/410] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/groups/96b0315da82246a893bcddbcb209368a => generated 229 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:59.716700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.764447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.767599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.768825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.769324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.771381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:59.773606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:59.780012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 206/411] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:59.781956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:50:59.794907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:50:59.892733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a2261-063e-4a13-8f33-9b9c715d7913 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:50:59.934212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:50:59.935055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:50:59.935347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:50:59.935623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] PATH_INFO: `/v3/projects/f8d8a528e88945da98e9389d0fe7141f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:50:59.939790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] RBAC: Authorizing `identity:get_project(project_id=f8d8a528e88945da98e9389d0fe7141f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:50:59.939790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:50:59.941125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 206/412] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/projects/f8d8a528e88945da98e9389d0fe7141f => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:50:59.951007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:00.023188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ed5f7-8b12-4c3f-93fd-db7e8f34f2f7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:00.091043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:00.092316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.092840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.093434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.094812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:00.104206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbd8b-1fe2-4897-9d6e-1e6aa17513c4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:00.105086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:00.106720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:00.108414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 207/413] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:50:59 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:00.115594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:00.136137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a07cc-c0d6-45b6-b89a-9deda61ea6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:00.137061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a07cc-c0d6-45b6-b89a-9deda61ea6bc None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.137347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a07cc-c0d6-45b6-b89a-9deda61ea6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.137629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a07cc-c0d6-45b6-b89a-9deda61ea6bc None admin] PATH_INFO: `/v3/projects/f8d8a528e88945da98e9389d0fe7141f/groups/96b0315da82246a893bcddbcb209368a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.142588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a07cc-c0d6-45b6-b89a-9deda61ea6bc None admin] RBAC: Authorizing `identity:create_grant(project_id=f8d8a528e88945da98e9389d0fe7141f, group_id=96b0315da82246a893bcddbcb209368a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:00.142588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a07cc-c0d6-45b6-b89a-9deda61ea6bc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:00.167702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:00.170147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 207/414] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 08:50:59 2022] PUT /identity/v3/projects/f8d8a528e88945da98e9389d0fe7141f/groups/96b0315da82246a893bcddbcb209368a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:00.284378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e393-7ce9-4520-a6d9-f87a0d28ea4c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:00.339229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:00.340516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.341006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.341478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.343902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=797ec60568f642e891fad08f02650c2c, group_id=df8778a2fa954dd8b1d4fdf7470c8360, role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:00.345553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:00.361462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3e9ef-12e8-4c91-9cf7-001e7edffe97 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.361822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3e9ef-12e8-4c91-9cf7-001e7edffe97 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.362204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3e9ef-12e8-4c91-9cf7-001e7edffe97 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.363698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 208/415] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:00.369179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.369550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.369840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.370610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 208/416] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 08:51:00 2022] PUT /identity/v3/projects/797ec60568f642e891fad08f02650c2c/groups/df8778a2fa954dd8b1d4fdf7470c8360/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 08:51:00.410532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:00.411785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:00.522166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 209/417] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:00.563299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:00.675219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:00.687866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f14c56-646f-41c6-a4f9-ca9d1200fdb9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:00.745810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:00.746663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.746949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.747225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.764840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:00.773018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:00.773964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:00.774779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 209/418] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:00.783961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:00.930129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:00.940335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac10a2e-19c3-48be-b1d6-efadb7f42d90 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:00.995803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:00.996493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:00.996777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:00.997051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:00.997800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:00.998108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:00.999506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d5696-6c0f-4d6e-9a69-8c9e2d3a4ab9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:01.009098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 210/419] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:01.014789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.170519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e02700-581f-4ac9-8bed-b52372cd6dfa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:01.192466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edafff1-dae2-4223-a11a-c2832841f194 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.192749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edafff1-dae2-4223-a11a-c2832841f194 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.192946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edafff1-dae2-4223-a11a-c2832841f194 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.198946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 211/420] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:01.199706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.200026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.200303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.225479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:01.226671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:01.229746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bce1ce-a7c1-4c76-ae90-c40f105272c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:01.230402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bce1ce-a7c1-4c76-ae90-c40f105272c1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.230681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bce1ce-a7c1-4c76-ae90-c40f105272c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.230957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bce1ce-a7c1-4c76-ae90-c40f105272c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.262189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:01.352063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bce1ce-a7c1-4c76-ae90-c40f105272c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:01.354084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bce1ce-a7c1-4c76-ae90-c40f105272c1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:01.364015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 212/421] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:01.421610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.498022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 210/422] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:01.499292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0835374-a641-4b04-80ae-757743ab1547 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.499584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0835374-a641-4b04-80ae-757743ab1547 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.504284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0835374-a641-4b04-80ae-757743ab1547 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.505933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 211/423] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:01.506706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0835374-a641-4b04-80ae-757743ab1547 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.524874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:01.540678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e230c1-2af3-472b-8150-3f9d3f3b7fa9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:01.561283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:01.590079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83ca60-8903-4e31-bbc3-5256f1df5f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:01.590886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ca60-8903-4e31-bbc3-5256f1df5f51 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.591170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ca60-8903-4e31-bbc3-5256f1df5f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.591444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ca60-8903-4e31-bbc3-5256f1df5f51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.605795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83ca60-8903-4e31-bbc3-5256f1df5f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-dc83ca60-8903-4e31-bbc3-5256f1df5f51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:01.618153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:01.620049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 213/424] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:01.621908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.623496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.623496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.631800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0835374-a641-4b04-80ae-757743ab1547 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:01.652761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:01.654839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:01.661200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:01.662154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.662510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.662875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.664262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:01.665830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:01.668442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 212/425] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:01.673563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.744207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 214/426] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:01.745322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.806106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb27634-12bb-45ca-a232-f919d96328ce None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:01.832292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:01.840931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:01.857389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:01.858072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.858355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.858631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.859382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:01.859692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:01.861099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:01.873074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 213/427] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:01.874113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.885378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c0ae-6222-487a-b391-4cc0a7579640 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:01.927516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:01.928640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:01.928927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:01.929206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:01.930442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:01.932361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:01.938961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 215/428] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:01.938961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:01.999283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2a24-013c-4c12-a5ab-c5f15a5bb330 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.042308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.043795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.044556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.045448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.051526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1a30-648c-4f43-b079-633dd0759282 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.059403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:02.071444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:02.072945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:51:02.073790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:02.081154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 214/429] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:02.081312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.101608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.102290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.102552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.102826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.116929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:02.141008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:02.186199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.187673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.220971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1107-b29e-4912-a5ef-86aec806dda9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.258831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.259545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.260470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.260759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.261596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=e304ec690b354614bc483c8980edbb91) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:02.261914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.263396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.275164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 215/430] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=2dc775396d5544848b5553a1e7bf708b => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:02.276215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.307650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 216/431] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:02.313630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.359992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:02.427484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c744-baa9-4537-8b78-00e1d39b63e9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.430196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:02.443265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591ed2-ba1d-46da-a949-bf68ca7b41bc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.476539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.477337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.477628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.477904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.478804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:02.479346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.480269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.480820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.481139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.481415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.481682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.482897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.484378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.486443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 217/432] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:02.492002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.509060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 216/433] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:02.515330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.688666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a04ff-c5a1-4f60-bdb9-054bce940255 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.694895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5219d9-f459-435e-b33d-4de6ea8a53ae None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.701255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:02.745315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.746314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.746488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782a70-91d0-4b16-b38c-5bfc03acfbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.746658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.746861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.747107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782a70-91d0-4b16-b38c-5bfc03acfbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.747390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782a70-91d0-4b16-b38c-5bfc03acfbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.747778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782a70-91d0-4b16-b38c-5bfc03acfbc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.748167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.749666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.753843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 218/434] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:02.759198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.796675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:02.839183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782a70-91d0-4b16-b38c-5bfc03acfbc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.841559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782a70-91d0-4b16-b38c-5bfc03acfbc1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.882822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9dcf-cefa-407e-85b0-9bbd08f12519 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:02.926955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:02.927649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.927939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.928217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.929055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=2dc775396d5544848b5553a1e7bf708b, scope.project.id=797ec60568f642e891fad08f02650c2c) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:02.929371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:02.930845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:02.938822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 219/435] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=2dc775396d5544848b5553a1e7bf708b => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:02.969474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 217/436] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 08:51:02.975222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:02.996078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f642fda-955e-4c0a-8fb1-3ec77cc3d00a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:02.996369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f642fda-955e-4c0a-8fb1-3ec77cc3d00a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:02.996646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f642fda-955e-4c0a-8fb1-3ec77cc3d00a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:02.998283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 218/437] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:03.003817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c46b2-41e1-4b62-96ed-9a73d046ee6a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.004084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c46b2-41e1-4b62-96ed-9a73d046ee6a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.004356 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c46b2-41e1-4b62-96ed-9a73d046ee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.026128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7b9c46b2-41e1-4b62-96ed-9a73d046ee6a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:03.028824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7b9c46b2-41e1-4b62-96ed-9a73d046ee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:03.035107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.113376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95cc86-674d-48a5-9e2e-ddcd646d86ad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.118808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.137519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 219/438] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:51:03.138810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9cbe9-1ecc-464d-b512-2452af33c63d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.139094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9cbe9-1ecc-464d-b512-2452af33c63d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.139372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9cbe9-1ecc-464d-b512-2452af33c63d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.141072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 220/439] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:03.154636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.154636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.155059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.165509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.167216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.167645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.168094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] PATH_INFO: `/v3/projects/e304ec690b354614bc483c8980edbb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.169366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] RBAC: Authorizing `identity:get_project(project_id=e304ec690b354614bc483c8980edbb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.170851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:03.174038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 220/440] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:51:02 2022] GET /identity/v3/projects/e304ec690b354614bc483c8980edbb91 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:03.174811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.175545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:03.177065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:03.261066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 221/441] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:03.262003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.299815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df96f9-fbd5-4385-a34f-295a19b0cd07 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.309041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.334197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.335005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.335298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.335580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.346324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:03.353940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:03.354989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 221/442] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:03.356657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.371624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3835bd-3595-40a7-88e1-0ecd4c5dc218 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.397078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.407679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.408581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.408861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.409136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.410313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.411786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:03.413412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 222/443] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:03.414167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.457476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8800-66cd-4ede-99a9-1fce71334089 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.492552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.493403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.493689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.493966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.504411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:03.512998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:03.513878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:03.514684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 222/444] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:03.515340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.516646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03129080-25f3-4cf9-af7a-b53aba356414 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.543902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.553555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.554222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.554504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.554778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.555524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:03.555864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.557249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:03.565849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 223/445] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:03.566449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.619961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e010d7d-092e-4c24-98b7-fa6c344e3277 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.622304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.654187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.654843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.655125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.655410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.656252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=e304ec690b354614bc483c8980edbb91) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:03.656563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.658012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:03.663858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 223/446] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=e304ec690b354614bc483c8980edbb91&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:03.664689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.683376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b78b1-6a1e-4acb-974d-2973b0bcd9dc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.726976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.727972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.728264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.728614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.729379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:03.729693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.731191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:03.742185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 224/447] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:03.747846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:03.774660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.786914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d767-db54-4e0e-9422-4010f7d43d8f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.832656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.833723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.834200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.834672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.866375 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46f5e9-be71-4b96-9974-9a89addc04d1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:03.886516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:03.908469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:03.909129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:03.909415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:03.909690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:03.916462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.918077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:03.990220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:03.991829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.032999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:04.044521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 224/448] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:04.050230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:04.111065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 225/449] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 08:51:04.116694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:04.136622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:04.166820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614744ab-19a5-4da2-9805-94d4d2bf5c26 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:04.210899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:04.212088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:04.212757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:04.213071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] PATH_INFO: `/v3/projects/f8d8a528e88945da98e9389d0fe7141f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:04.214527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] RBAC: Authorizing `identity:get_project(project_id=f8d8a528e88945da98e9389d0fe7141f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:04.216520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.218957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 225/450] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:51:04 2022] GET /identity/v3/projects/f8d8a528e88945da98e9389d0fe7141f => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:04.223727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:04.234441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6b3cc-7f64-4cb5-9b6c-fd2e3dbbbc65 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:04.269024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:04.269889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:04.270167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:04.270435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] PATH_INFO: `/v3/projects/797ec60568f642e891fad08f02650c2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:04.271640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] RBAC: Authorizing `identity:get_project(project_id=797ec60568f642e891fad08f02650c2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:04.273137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.274834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 226/451] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:51:04 2022] GET /identity/v3/projects/797ec60568f642e891fad08f02650c2c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:04.280292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:04.285381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:04.327824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44df7-0a80-4c79-97a5-46f460898d4a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:04.361088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:04.361946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:04.362229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:04.362495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] PATH_INFO: `/v3/groups/96b0315da82246a893bcddbcb209368a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:04.363654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] RBAC: Authorizing `identity:get_group(group_id=96b0315da82246a893bcddbcb209368a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:04.365132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.365801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:04.366734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 226/452] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:51:04 2022] GET /identity/v3/groups/96b0315da82246a893bcddbcb209368a => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:04.373184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:04.381906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b0d5-c3fb-4223-bdb1-e8cc1c6448c5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:04.416715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:04.417579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:04.417862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:04.418143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] PATH_INFO: `/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:04.419331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] RBAC: Authorizing `identity:get_group(group_id=df8778a2fa954dd8b1d4fdf7470c8360)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:04.420822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.422447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 227/453] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 08:51:04 2022] GET /identity/v3/groups/df8778a2fa954dd8b1d4fdf7470c8360 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:04.428360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:04.473353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969290-c2e7-4cc8-805e-d73718ab0b3e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:04.499930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:04.508215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:04.508865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:04.509143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:04.509421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:04.510240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] RBAC: Adding query filter params (group.id=96b0315da82246a893bcddbcb209368a, role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=f8d8a528e88945da98e9389d0fe7141f) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:04.510550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:04.512045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeb51d-dd6d-46db-9bd9-c88ef510e128 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.517877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 227/454] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:51:04 2022] GET /identity/v3/role_assignments?group.id=96b0315da82246a893bcddbcb209368a&scope.project.id=f8d8a528e88945da98e9389d0fe7141f&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:04.529761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f7dd-7691-4496-9310-d2a130630a12 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:04.567450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:04.568144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:04.568485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:04.568703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:04.569539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] RBAC: Adding query filter params (group.id=df8778a2fa954dd8b1d4fdf7470c8360, role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=797ec60568f642e891fad08f02650c2c) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:04.569852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:04.571331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9bad-a746-4b04-a28a-bfb2882449ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:04.578081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 228/455] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 08:51:04 2022] GET /identity/v3/role_assignments?group.id=df8778a2fa954dd8b1d4fdf7470c8360&scope.project.id=797ec60568f642e891fad08f02650c2c&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:07.492577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148d7c-6eb1-4446-9695-bc60566daf20 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.493623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148d7c-6eb1-4446-9695-bc60566daf20 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.494686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148d7c-6eb1-4446-9695-bc60566daf20 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.496584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 228/456] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:07.501526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433894d-4f9f-4b58-9b39-1c1ca8494038 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.502353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433894d-4f9f-4b58-9b39-1c1ca8494038 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.502853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433894d-4f9f-4b58-9b39-1c1ca8494038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.524958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8433894d-4f9f-4b58-9b39-1c1ca8494038 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:07.526212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8433894d-4f9f-4b58-9b39-1c1ca8494038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:07.544452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:07.614387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 229/457] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:51:07.651088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148d7c-6eb1-4446-9695-bc60566daf20 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:07.683553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c3d7-09e8-498d-a8f3-7c38095fe9d0 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.684552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c3d7-09e8-498d-a8f3-7c38095fe9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.685108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c3d7-09e8-498d-a8f3-7c38095fe9d0 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.687479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 230/458] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:07.703866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc538d-7cdd-4aca-89a2-7330fdc0ad51 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.704501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc538d-7cdd-4aca-89a2-7330fdc0ad51 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.704974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc538d-7cdd-4aca-89a2-7330fdc0ad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.732248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-99bc538d-7cdd-4aca-89a2-7330fdc0ad51 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:07.733464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-99bc538d-7cdd-4aca-89a2-7330fdc0ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:07.800628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148d7c-6eb1-4446-9695-bc60566daf20 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:07.818852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 231/459] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:07.825108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063cba-ad25-4ce2-8002-e89369231afd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.825557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063cba-ad25-4ce2-8002-e89369231afd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.825980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063cba-ad25-4ce2-8002-e89369231afd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.831420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 232/460] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:07.837193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.837637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.838080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.839051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:07.840393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:07.841052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:07.841527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:07.852744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:07.855193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:07.867522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:07.868830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:07.876108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:07.877005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:07.877863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:07.877863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:07.877863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:07.877863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:07.879959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 229/461] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:07.881144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:07.944151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:07.953175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 233/462] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:07.954329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:07.970850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.032719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e64b-8909-4c76-988b-366bbda3b628 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.084171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.084898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.085179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.085453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.100496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.101974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.107774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89062e41-8adb-40f4-a031-3121d07bf08c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:08.122267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:08.123254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:08.124141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:08.124141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:08.124141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:08.124141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:08.126371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 230/463] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:08.127368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.158190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.158898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.159182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.159461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.160513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:08.160826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.163005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.179520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 234/464] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:08.180535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.242253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.251378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce846e-bcd8-4727-a30a-b131dbf2b737 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.278291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.289109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.289915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.290196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.290468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.301528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.303006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.318571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12762-193a-41c2-a29b-077ecd6e75b1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:08.321380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:08.322807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:08.323669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:08.323669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:08.323669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:08.323669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:08.323669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 231/465] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:08.323966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.359467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.360090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.360508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.360679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.361390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:08.361695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.363093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f7abe-5065-4876-9fca-c75a0f7628b5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.380568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 235/466] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:08.380568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8bdb-15dc-4067-9f42-b67cbc4e087d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.380568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8bdb-15dc-4067-9f42-b67cbc4e087d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.380568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8bdb-15dc-4067-9f42-b67cbc4e087d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.380568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 236/467] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:08.382014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf8bdb-15dc-4067-9f42-b67cbc4e087d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.451829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49e29-13f5-427e-a19c-18ab813bce66 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.488409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.488622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf8bdb-15dc-4067-9f42-b67cbc4e087d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.489091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.489369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.489645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.490346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.491814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.514920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 232/468] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:51:08 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:08.515739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.521303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.540386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.546464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.547472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.548032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.548453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.549506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:08.550007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.551815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3371c-7e62-4254-8498-a95c3414bb71 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.569330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 237/469] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:08.571351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.571641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.571975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.595796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:08.597459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:08.656428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f677b6-9a65-49e5-8528-2cac46bbf280 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.701510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.702211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.702492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.702765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.703483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.705073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.708339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 238/470] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:08.709562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.731792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 233/471] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:51:08 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:08.744988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.827702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.860729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df412e98-f23a-4301-af75-c5124baff5f4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.881077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19411-ab16-43cd-8cc5-8bb702f33e7c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:08.881644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:08.902531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.903227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.903502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.903797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.904516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.906011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.929893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:08.930936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.931925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.932395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.934098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 239/472] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:51:08 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:08.948737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:08.950700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1f058a74-5002-454d-88bf-59a1a2e4d7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:08.973022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:08.974151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:08.975192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:08.975192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:08.975192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:08.975192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:08.977333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 234/473] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:08.983027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:08.994609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de121a0-396c-45b8-baa7-c6bb76e7f65c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:08.995214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de121a0-396c-45b8-baa7-c6bb76e7f65c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:08.995493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de121a0-396c-45b8-baa7-c6bb76e7f65c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:08.997316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 235/474] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:09.003390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:09.003834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:09.004217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:09.027669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:09.029098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:09.122031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 236/475] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:51:09.128275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5bc64-c38c-4639-92e6-1c3dd5ddc2a7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:09.159312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:09.169896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:09.170680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:09.170962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:09.171237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:09.173176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:09.173176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:09.173717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:09.189779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 240/476] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:09.195063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:09.225722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:09.235860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:09.305495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c0319-cc95-425d-b707-566a0e034425 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:09.332828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501bd5-66b0-47a8-a9e9-21296de59aab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:09.346709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:09.347632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:09.348095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:09.348543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:09.349423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:09.350966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:09.359494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.sql.core [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 08:51:09.359494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 08:51:09.359494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [parameters: {'id': 'f91ed3220bd042da8b7f978110547a81', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 08:51:09.359494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80221) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 08:51:09.375390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:09.376249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:09.376661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:09.377031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:09.377840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:09.379382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 08:51:09.379739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return ref.to_dict() Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 08:51:09.380735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application yield resource Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise self.value Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application session.commit() Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 08:51:09.381844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.flush() Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application compat.raise_( Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 08:51:09.382882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 08:51:09.384026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 08:51:09.385107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [parameters: {'id': 'f91ed3220bd042da8b7f978110547a81', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:09.386088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 08:51:09.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:09.390100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 237/477] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 08:51:09 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:09.403180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:09.414821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 241/478] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:51:09 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:51:09.544915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e538c0-c5dc-4118-9f7c-a2a572476a12 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:09.556426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:09.598078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313e04-6112-49e2-af94-501a0eea75c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:09.598923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313e04-6112-49e2-af94-501a0eea75c6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:09.599212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313e04-6112-49e2-af94-501a0eea75c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:09.599488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313e04-6112-49e2-af94-501a0eea75c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:09.615526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92313e04-6112-49e2-af94-501a0eea75c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-92313e04-6112-49e2-af94-501a0eea75c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:09.624658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:09.625788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:09.626759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 238/479] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:09.632803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:09.744025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:09.756324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d25351-1e10-4b97-8af8-af6bc2d7d5fa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:09.792956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:09.793637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:09.793912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:09.794185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:09.795008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:09.795273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:09.796660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b989-db64-4bbd-8dbc-bec5c74ae2f7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:09.806891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 242/480] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:11.615636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3c5b-6e47-40d2-8dd6-18c2d107a0d1 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:11.616592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3c5b-6e47-40d2-8dd6-18c2d107a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:11.617044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3c5b-6e47-40d2-8dd6-18c2d107a0d1 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:11.618859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 239/481] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:11.629324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:11.630279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:11.630735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:11.646381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a881-cfc5-4d14-8c31-1eaaed544a95 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:11.646940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a881-cfc5-4d14-8c31-1eaaed544a95 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:11.647390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a881-cfc5-4d14-8c31-1eaaed544a95 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:11.648952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 240/482] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:11.655808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:11.655808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:11.655808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:11.657187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:11.658632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:11.688911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:11.690123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:11.771797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 243/483] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:11.771985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 241/484] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:51:11.793189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:11.811359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:11.924702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:11.960064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758864e-e7e1-485e-9b4c-ae9bcba63e5b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.012631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be109e4-2981-4cca-bcba-a7444ac12cbc None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.018420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b57f4-50f0-4196-8c57-b2f355ca71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.019602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b57f4-50f0-4196-8c57-b2f355ca71fa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.020161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b57f4-50f0-4196-8c57-b2f355ca71fa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.020641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b57f4-50f0-4196-8c57-b2f355ca71fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.036186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b57f4-50f0-4196-8c57-b2f355ca71fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:12.040122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-506b57f4-50f0-4196-8c57-b2f355ca71fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:12.048106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:12.049171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:12.050111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:12.053282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 244/485] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:12.056241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169392e7-f9fe-4de5-9752-ba0e18cb72e4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.057184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8513-4388-495c-9736-a9f43a573a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.057390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169392e7-f9fe-4de5-9752-ba0e18cb72e4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.057800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169392e7-f9fe-4de5-9752-ba0e18cb72e4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.058301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8513-4388-495c-9736-a9f43a573a6d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.059019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8513-4388-495c-9736-a9f43a573a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.059402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8513-4388-495c-9736-a9f43a573a6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.060049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 245/486] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:12.060920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169392e7-f9fe-4de5-9752-ba0e18cb72e4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.073477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8513-4388-495c-9736-a9f43a573a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b2aa8513-4388-495c-9736-a9f43a573a6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:12.083589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:12.084617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:12.085594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:12.087983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 242/487] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:12.089468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.090465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.090859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.111449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:12.112931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:12.202231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169392e7-f9fe-4de5-9752-ba0e18cb72e4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.213247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 243/488] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:12.214329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.259842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.260822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.261249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.261772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.262751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:12.263270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.264979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:12.275782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 246/489] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:12.277020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.281166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.317813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.335919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7932-dfe9-463e-a2bf-76b0a0a40fba None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.374138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.374513 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.374684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.374952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.375702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:12.376041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.377431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:12.386959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 244/490] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:12.388051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.412803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66198d-a5d0-4c28-abc7-b8ec03d1d83f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.453123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.454198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.454632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.455050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.469422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:12.477663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:12.478732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:12.479543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:12.486294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 247/491] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:12.487378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.504572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e21dc-2c45-428b-806c-31d71c997917 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.544417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.545233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.545518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.545794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.560953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.569535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:12.571889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.573017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:12.582705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:12.583948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:12.585290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:12.585290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:12.585290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:12.585290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:12.585290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 245/492] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:12.585649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.627328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9e2c9-f03d-4493-986f-e7a5fe084783 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.674183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.675012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.675274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.675542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.689094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.690597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8cb72657-f941-4a38-982c-8a21d15076dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:12.710131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:12.711027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:12.711915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:12.711915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:12.711915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:12.711915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:12.716090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 248/493] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:12.717819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f133-c7f5-4079-b196-30067cde7b98 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.718115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f133-c7f5-4079-b196-30067cde7b98 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.718395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f133-c7f5-4079-b196-30067cde7b98 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.720528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 249/494] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:12.721361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f133-c7f5-4079-b196-30067cde7b98 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.759587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22fd3-11b2-4d1f-8d31-f0ce8a7b4347 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.807020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.807711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.808028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.808300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.809070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:12.809378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.810809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:12.824233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 246/495] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:12.824778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:12.863095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f133-c7f5-4079-b196-30067cde7b98 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.880198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.896024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:12.901982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.902668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.902981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.903204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.903970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:12.904336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.905736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5e8a1-b88d-438b-9ee3-afc1d2146874 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:12.917900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 250/496] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:12.919172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.919459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.919733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.938909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:12.940312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:12.948810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf335bc-b016-4753-86fb-562802350e7f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:12.983055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:12.983644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:12.983976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:12.984373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:12.985100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:12.985423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:12.986835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88b3d6-eb3d-4f95-9680-ac92126fff05 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.005569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 247/497] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:13.006984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542340-f526-4b56-88f5-ca1f5c07a95f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.007276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542340-f526-4b56-88f5-ca1f5c07a95f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.007553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542340-f526-4b56-88f5-ca1f5c07a95f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.008978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 248/498] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:13.010153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542340-f526-4b56-88f5-ca1f5c07a95f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.031783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 251/499] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:13.031783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.116541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb08f61-75b1-4203-8781-9cb3d92496f7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.117079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542340-f526-4b56-88f5-ca1f5c07a95f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.124767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:13.141621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:13.153808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.154425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.154608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.154888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.155243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.155350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.155442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.155794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.163007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.164561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.166314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.167835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:13.183070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:13.184077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:13.184999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 252/500] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:13.185544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3d0bbb79-d59f-462e-81b1-fc82508c6004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:13.187236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:13.188143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:13.188976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:13.188976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:13.188976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:13.188976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:13.188976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 249/501] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:13.189978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.190269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.190548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.207159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:13.208389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:13.281660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 250/502] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:13.281907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.298828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd1999-c399-4a8d-b6b6-6ec6941b57dc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.338392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.339216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.339493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.339796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.348158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.349684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:13.366288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:13.367402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:13.368355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 253/503] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:13.369539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.401072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:13.479779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac48f4-b4de-48a1-b8b8-5d44aad0795a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.517597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.518287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.518569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.518843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.519696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:13.520139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.521530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.522625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86e733-1008-437e-87a9-a62adf4441ab None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.524969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:13.559822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.560634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.560915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.561196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.565143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 254/504] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:13.565994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.576460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:13.584397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:13.586106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 251/505] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:13.588178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.675438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:13.695749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1dd0-ff85-43de-b5e1-567d690155f3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.702072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d8a3-4f6a-481f-ba12-2129fe045d7c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.733982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.734659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.734954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.735277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.736067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:13.736380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.737796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.741090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.742006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.742395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.742757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.753381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 255/506] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:13.754009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.755866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.757802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:13.779178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:13.780604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:13.781472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:13.781472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:13.781472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:13.781472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:13.781472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 252/507] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:13.781472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.805938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:13.880811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9b21a-a742-4dfc-8cce-e0be2ec23637 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.905142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4975e1-a345-4ffc-a308-005451a3fcd5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:13.920071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.920758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.921039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.921308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.922147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:13.922456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:13.923953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:13.943313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:13.944017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:13.944300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:13.944585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:13.944888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 256/508] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:13.945729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:13.951936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.023027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.024622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.046633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.149032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 253/509] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:14.149817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.192614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0a476-3263-4ebc-980e-de2dba98ab03 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.229465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.230178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.230471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.230748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.231511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:14.231851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.233280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.243024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 257/510] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:14.243923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.271747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0187-cfd3-4aba-ae8a-6f19736303e4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.290218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.311212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.312078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.312366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.312658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.321419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.322928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.323958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:14.343709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:14.345521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 254/511] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:14.347277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.371334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0302cf-ecf6-498a-9fd2-f2bb49e8ad53 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.407579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.408212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.408492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.408766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.409495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:14.409802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.411206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.424179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 258/512] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:14.425320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.460935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2a02-cb27-47a4-a8f4-2e2fa8058142 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.499324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.500023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.500309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.500590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.550264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.553403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8cc2e-c7b2-4087-81d6-ef4fcfe17fcd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.576717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.578223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.579796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.592960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.593831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.594193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.594580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.606802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.608346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:14.630830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:14.631832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:14.638660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:14.638660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:14.638660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:14.638660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:14.638660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 259/513] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:14.638660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.708383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 255/514] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:14.709260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.752928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9d534-24d8-4237-aab9-36abdb3a53e1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.788899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.789708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.789995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.790273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.801676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.802858 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.804409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:14.823481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:14.824542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:14.825418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:14.825418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:14.825418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:14.825418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:14.825418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 260/515] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:14.825677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.830150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7688e-3430-4346-8d35-8ea934614141 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.855716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:14.869918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.870608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.870885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.871152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.872020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:14.872329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.873777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.915971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 256/516] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:14.916643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:14.932713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164cfe2-2b9b-42b2-a7ea-71597dabd5e8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:14.966844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:14.967438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:14.967713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:14.968015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:14.968718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:14.970166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:14.991572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 261/517] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:51:14 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:14.992436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.035820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21f7-665d-4646-88ce-dbd83d1b693a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.078074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.078915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.079154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.079460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.080278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:15.080591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.082015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.084019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.097468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 257/518] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:15.098226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.116247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.137593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8e874-ad6e-4776-8888-562b7eca6d9b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.175344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.176445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.176847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.177121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.189556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.191026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:15.209841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:15.210733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:15.211558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:15.211558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:15.211558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:15.211558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:15.211558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 262/519] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:15.213457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.238466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6919e-70e6-4d54-bf65-7ce5a3eb7bd6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.275900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.276579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.276862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.277134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.277853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:15.278164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.279559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.293163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 258/520] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:15.294010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.342500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4e47f-3efc-433c-a915-faf60107d973 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.368679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.391733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.392801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.393278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.393749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.400818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.449691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0db3-074d-4fe3-9190-4707ecf28473 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.488325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.490230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.490416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.491016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.491301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.491574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.501283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.503156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:15.519881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:15.520807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:15.521778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 259/521] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:15.522247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.612952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 263/522] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:15.614167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.647684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b051e9-3b09-4e42-a6af-ed9942014f39 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.654661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.667257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.689695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.690606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.691075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.691354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.692124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:15.692432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.693886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.707224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 260/523] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:15.708275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.735835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5b12-4adf-419c-87ac-4a2a26dbc68f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.774954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.776261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.776508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.776773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.784968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.786445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:15.807152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:15.808182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:15.809164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 264/524] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:15.809716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.835240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e84e-ad2c-4178-b85a-c6d01ec5cc48 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.874561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.875239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.875527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.875827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.876736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:15.877048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.878608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.898595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 261/525] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:15.899461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:15.916738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.924228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca37d-aa3d-4182-a562-2903adf22766 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:15.936706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:15.963449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:15.964282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:15.964559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:15.964830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:15.978793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:15.980317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:15.999773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:16.001584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:16.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:16.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:16.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:16.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:16.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 265/526] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:16.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.024835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e999c1-4cd6-4fb7-bfe5-c2fed79c7cd3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.069817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.070719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.071062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.071401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.079250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.080838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:16.095414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:16.096551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 262/527] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:16.097453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.120967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46c561-078c-4f01-a4e0-ab87b7b34d67 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.175192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.180463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.180831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.181069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.182095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:16.182408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.185185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.218033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 266/528] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:16.218033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.230836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:16.248131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:16.261985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8016-ab71-40e0-8966-7e8e65e4afe4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.310018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.310888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.311200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.311829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.313056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=12f623ab113a43b791f0180286fa5ac3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:16.313579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.315643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.325310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 263/529] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/role_assignments?user.id=12f623ab113a43b791f0180286fa5ac3&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:16.326116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.442154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c50d-b089-49cf-9792-e1b58f4d9fab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.489856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5ce8e-6aa5-46cf-a1f2-30963dec3c12 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.495879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.496582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.496865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.497141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.497892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:16.498214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.500080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.516635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 267/530] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:16.517534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.597620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.603350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.603350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.603350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.603350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:16.603350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.603350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.615575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:16.632045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 264/531] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:16.635801 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.678129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:16.685922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9211-86b7-4e80-b04d-20cc93dc30e0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.741998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.742917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.743221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.744399 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.808204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1cfc-4966-4fc5-be51-413f02778ad7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:16.839846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.841335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.849918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:16.850664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:16.850943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:16.851214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:16.860047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:16.861757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:16.878835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:16.879745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:16.881444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 265/532] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:16.886732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:16.925931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:16.977815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 268/533] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:16.978839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.017429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:17.043383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bed98-0146-4afe-880e-8c3dad5660c8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.079746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.080683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.081116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.081574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.082552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=120533a970c74d98af45911ba7e6a375) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:17.083013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.084628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.096586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad0de6-4d70-453a-aab7-8c4466af0813 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.096862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 266/534] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/role_assignments?user.id=120533a970c74d98af45911ba7e6a375&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:17.097969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.135266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.135712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.136036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.136307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.137102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:17.137408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.138859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.167795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 269/535] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:17.167795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.197651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:17.283712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ee421-a962-4546-80f8-572a5a61967f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.326035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.326421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72da2d-3110-4b03-85ea-35dd1c97ac94 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.326707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.326985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.327259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.328122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=c06192133f444b13933b7c4a1997e3cb) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:17.328433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.335782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e3479-7c03-4a1b-8f31-ea715ffcf01f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.338166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 270/536] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/role_assignments?user.id=c06192133f444b13933b7c4a1997e3cb&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:17.340331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a658c-0634-4eff-9b81-b00c16429c43 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.340619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a658c-0634-4eff-9b81-b00c16429c43 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.340892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a658c-0634-4eff-9b81-b00c16429c43 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.343228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 271/537] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:17.348987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.349306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.349533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.386992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.387740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.388279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.388561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.401036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:17.402253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.402386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:17.403821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.406990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:17.431109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:17.432743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:17.435249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:17.435249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:17.435249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:17.435249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:17.435249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 267/538] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:17.438575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.521111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 272/539] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:17.564873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.591820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcab553-58b8-47fe-aeae-cf6849b28e8a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.604180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:17.639304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.639658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.639972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.640246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.640996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:17.641303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.643601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.660816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 268/540] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:17.668830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.699391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696b4e4-5dbc-4ed4-a98f-0519fe4be455 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.746821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.750479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.752103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.753443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.776122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:17.784407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:17.785318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:17.786113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:17.788113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:17.788869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 273/541] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:17.795325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.838921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14538f9a-293c-4f15-ae35-3ec2d74c246d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.885911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.886715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.886999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.887273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.898946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.905361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:17.908579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.926496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a51bc6-ff5c-4b72-8df3-1c089e65746e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:17.928899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:17.929744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:17.930582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 269/542] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:17.936373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:17.963248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:17.963958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:17.964241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:17.964517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:17.965289 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:17.965602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:17.967386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:17.982300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 274/543] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:17.988469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:18.147812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437c9cc-9daf-4b62-bc77-4649bf0cc7ae None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:18.165436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:18.189645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639c80-41b2-4f18-b4e7-80616536e20f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:18.195095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:18.195865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:18.196151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:18.196424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:18.197861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:18.198188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:18.200156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:18.228891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 270/544] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:18.235097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:18.251735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:18.253677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:18.253677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:18.253677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:18.265427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:18.267453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:18.292156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:18.293101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:18.293951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:18.293951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:18.293951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:18.293951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:18.293951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 275/545] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:18.294219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:18.299873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:18.461560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01505c6-0bc5-4e53-815f-56cc0ea7b933 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:18.474008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca0f53-144d-47c2-ad29-6a447a58d794 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:18.527863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:18.528566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:18.528904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:18.529216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:18.530151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=98347f8bc43f46b0aa0d6fb38c162885) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:18.530504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:18.532116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:18.536394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:18.537072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:18.537353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:18.537628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:18.538366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:18.538673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:18.540079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:18.552558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 271/546] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:18 2022] GET /identity/v3/role_assignments?user.id=98347f8bc43f46b0aa0d6fb38c162885&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:18.562623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 276/547] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:18.568597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:18.629928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:18.708920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b81fa-ec07-44f0-9ec4-dc5136eab9c2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:18.769176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:18.769922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:18.770207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:18.770481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:18.783734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:18.785354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:18.803326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:18.804853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:18.805926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 272/548] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:18.811464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:18.880648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:18.921523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617c29b-90ed-4a7c-ae8e-3fc3a905556e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:18.959300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:18.960011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:18.960291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:18.960566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:18.961419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:18.961729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:18.963249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38bd5d-7463-43a4-9c68-0f21023d3255 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:18.983104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 277/549] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 08:51:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:18.989240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:19.030352 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750f45-2a4e-46af-9843-bc9de9c14181 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:19.030635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750f45-2a4e-46af-9843-bc9de9c14181 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:19.030808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750f45-2a4e-46af-9843-bc9de9c14181 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:19.032622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 278/550] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:19.038215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:19.038503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:19.038787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:19.070837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:19.072131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:19.171945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 279/551] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 08:51:19.175273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:19.179899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7be37-447b-4a53-b628-172af0c67796 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:19.200913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:19.224958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:19.225622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:19.225915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:19.226189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:19.252240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:19.358072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ddd75-8aee-4872-9e66-c4039ad0b660 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:19.377047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:19.378586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:19.405624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:19.406832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:19.407359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:19.407883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:19.440777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:19.449706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:19.450831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:19.451693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:19.454604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 280/552] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:19.459981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:19.519389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:19.526483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 273/553] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:19.533140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:19.652233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523714-fea0-47dd-8259-a113e61c33b3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:19.663274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:19.716660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f80a6-327d-4dc4-ae4f-c8eec4552f00 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:19.727198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:19.727905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:19.728231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:19.728541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:19.729370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:19.729673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:19.731069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:19.745817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 281/554] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:19.751940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:19.791256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:19.792088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:19.792368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:19.792637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:19.809741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:19.811241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:19.846968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:19.847968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:19.848867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:19.848867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:19.848867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:19.848867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:19.852518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 274/555] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:19.861806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:19.950324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.006893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb625-1c5b-4b8f-a281-3db16069fd40 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.025803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2792879-9ff1-4115-bc13-117ef0c50662 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.044408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.045086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.045366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.045640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.046370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:20.046677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.048097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.061773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 275/556] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:20.070254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.105278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.107993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.108273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.108547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.127793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.129615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1579e4d9-43e9-42f1-ae18-0718a2f8d0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:20.149690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:20.152857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 282/557] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f52045-c8ea-4194-bb05-6336a66716cd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f52045-c8ea-4194-bb05-6336a66716cd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.155013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f52045-c8ea-4194-bb05-6336a66716cd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.156122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 283/558] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:20.160100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f52045-c8ea-4194-bb05-6336a66716cd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.182067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.218869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c288dd-eecf-4935-81a2-f993ff73890e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.232338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.259415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.260538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.260821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.261092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.268699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.270159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f19c7796-708b-4320-8f2d-195e4a92e362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:20.286585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:20.288576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:20.289730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:20.291472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f52045-c8ea-4194-bb05-6336a66716cd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.293695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 276/559] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:20.294956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65233bf4-b194-4338-80e4-e53e5263de12 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.296550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65233bf4-b194-4338-80e4-e53e5263de12 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.296550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65233bf4-b194-4338-80e4-e53e5263de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.314837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-65233bf4-b194-4338-80e4-e53e5263de12 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:20.316503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65233bf4-b194-4338-80e4-e53e5263de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:20.338367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.339164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.339447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.339718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.340651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:20.340969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.342451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a36c80-646f-453f-beea-b04f960f3329 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.366610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 284/560] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:20.366610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d0be7-88e5-4574-9d9e-28083c07c252 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.366610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d0be7-88e5-4574-9d9e-28083c07c252 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.366610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d0be7-88e5-4574-9d9e-28083c07c252 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.366610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 285/561] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:20.366610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d0be7-88e5-4574-9d9e-28083c07c252 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.401370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 277/562] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:20.403059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.403335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.403670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.423727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:20.425150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:20.486966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.517719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 278/563] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:20.519661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.544511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d0be7-88e5-4574-9d9e-28083c07c252 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.574008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.586043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.586715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.586997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.587263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.588652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:20.588968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.590411 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.608122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 286/564] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:20.609089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.683023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c438-9231-49db-8074-7bbf58395473 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.724999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.726286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.726737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.727020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.735467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.737117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.737995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19b440-3a66-47cf-80a7-8713a73f384a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:20.753065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:20.754112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 08:51:20.755081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:20.758940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 279/565] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:20.760209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.778657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.779382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.779736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.779957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.783000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.793286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:20.801334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:20.802363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:20.803228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:20.807459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 287/566] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:20.808400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.862122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:20.873224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3179-9290-4704-a0ff-2035041719a9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.913897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.914824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.915112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.915390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.928303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa98c9-4bf2-4216-99e8-5040ecf4ca16 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:20.928777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:20.937299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:20.938395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:20.939355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:20.941176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 280/567] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:20.941936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:20.968346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:20.969021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:20.969319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:20.969796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:20.970646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=d8b00fb60e5e4548a5371831e56ad76b) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:20.970966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:20.972460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:20.978644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 288/568] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/role_assignments?user.id=d8b00fb60e5e4548a5371831e56ad76b&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:20.979471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.080162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:21.080860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c2fc-6d88-402f-8c75-fea98336772e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.125391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.126089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.126374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.126662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.127500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:21.127868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.129355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.152484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85988c02-7a1b-49b4-af0b-3fd5de49ef63 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.154599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 281/569] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:21.155610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.167833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:21.216169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.217433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.218024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.218024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.218724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:21.219029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.220592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.231357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 289/570] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:21.232296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.274320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92299c-847b-4510-a348-25dbf287b899 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.313082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.313773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.314059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.314334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.315097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:21.315408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.316846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.326160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 282/571] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:21.326861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.379127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5768-7c34-4056-9178-658af84b225b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.411096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:21.416795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:21.434324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.434811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.435089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.435311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.449285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.450788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.453664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37431a-2a62-428e-9205-b691201c65e7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:21.469489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:21.470565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:21.471462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:21.471462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:21.471462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:21.471462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:21.471462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 290/572] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:21.472351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.503677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.505414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.505750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.506198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.521021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.523168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-aed81145-aefc-4ee7-9038-b9f64a0ddf42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:21.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:21.559465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:21.560635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:21.560635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:21.560635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:21.560635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:21.564072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 283/573] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:21.565359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fee9d-9949-4684-9f2d-dbc411b7f87c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.565642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fee9d-9949-4684-9f2d-dbc411b7f87c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.565914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fee9d-9949-4684-9f2d-dbc411b7f87c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.567452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 284/574] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:21.569430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fee9d-9949-4684-9f2d-dbc411b7f87c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.598233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1430-2346-4a49-98eb-f3ad536f7bd6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.640614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.641446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.641796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.642150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.655737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.657348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:21.677136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:21.678311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:21.679555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:21.679555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:21.679555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:21.679555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:21.679961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 291/575] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:21.680749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.719445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fee9d-9949-4684-9f2d-dbc411b7f87c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.723243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:21.750701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:21.768814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.770001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.770516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.771083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.772436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:21.773076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.776388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152a20-b3fe-44ef-9d82-5f751ff3e51a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.799497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 285/576] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:21.802209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.802736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.803244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.825184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:21.826301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:21.847217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c3c1-b17a-482d-85c0-77c55b313590 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:21.893546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:21.894208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:21.894495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:21.894762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:21.896004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:21.896004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:21.897218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:21.921921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 292/577] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:21.921921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:21.939734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 286/578] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:21.939734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.062553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:22.083639 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cec31-8a08-47a9-a95e-25dada3655a5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.085272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9b03-a99c-425f-a1eb-6b6c3b09ebe8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.102762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:22.130080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.131279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.131589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.132337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.140237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.140473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.141407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.141767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.141966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.142441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.143899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:22.144473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.147236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:22.158962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:22.159961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:22.160980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:22.167973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 287/579] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:22.167973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.171026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 293/580] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:22.175883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.301279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51a68e-d57f-4c6f-a481-aaead46c623b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.351799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e762e2-7a5a-4788-a81b-5cec3be7f3a3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.363590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.365068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.365641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.366202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.381201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.384169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:22.412673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:22.413686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:22.414696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:22.420310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 288/581] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:22.420310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.424739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.426528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.427126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.427716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.448420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:22.463706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:22.464933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:22.465984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:22.473660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 294/582] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:22.473660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.485358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:22.488240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:22.585727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3962b2-12a8-4fb3-ba34-1d334a2c5a8a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.623211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f7b2-1756-41e9-902f-e5cc79b6f3c3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.624234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.624896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.625179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.625442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.626228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:22.626532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.627987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.645702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 289/583] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:22.645702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.664743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.665675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.666032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.666381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.674492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.676359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:22.691480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:22.692735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:51:22.693874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:22.698341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 295/584] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:22.699048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.749066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:22.760877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b296-280d-4361-a7a9-bfbaae0b8482 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.769508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:22.800125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.800905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.801508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.801852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.802767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:22.803149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.804733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.815615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711fafe-e699-4fe8-9905-73cebd994d98 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:22.827886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 290/585] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:22.827886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.855535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:22.856236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:22.856515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:22.856931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:22.857541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:22.857843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:22.859232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:22.876520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 296/586] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:22.876520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:22.952102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764099af-0953-47e0-825a-b33eefeb089a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.021187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.021187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.021643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.022016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/12f623ab113a43b791f0180286fa5ac3/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.035838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e5481-6b58-44ee-b391-7d451949ff9f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.049364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=12f623ab113a43b791f0180286fa5ac3, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.051614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.066187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:23.073031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:23.083901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 291/587] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:22 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/12f623ab113a43b791f0180286fa5ac3/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:23.086016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.087287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.087940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.088517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.089031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.090714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:23.091354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.094226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.134196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 297/588] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 08:51:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:23.135816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.289444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72f8a-9b5a-45d2-8699-deacc42d7ab2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.310331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb672a2-8ec9-4c08-b10e-1dfd63d4c738 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.335215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.336086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.336383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.336660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.348348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.349834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.354093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.355198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.355743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.356243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:23.370026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:23.371453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:23.373595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:23.373595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:23.373595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:23.373595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:23.373595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 292/589] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:23.376680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.377010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.379814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:23.408229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:23.409233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:23.410103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:23.410103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:23.410103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:23.410103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:23.412888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 298/590] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:23.414339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.452995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:23.484619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:23.532876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec697-c36f-445e-ae5f-8d0935ac1350 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.566410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e058-4ab4-45a5-bfda-0329df695592 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.608195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.609048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.609321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.609599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.610986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.611838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.612262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.612712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.613437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:23.613747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.615132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.621893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.623369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.632766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 299/591] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:23.632766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-329ab399-1a10-4774-95aa-02d3746e6334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:23.644788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:23.645763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:23.646644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:23.646644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:23.646644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:23.646644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:23.646644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 293/592] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:23.647411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604e0d-f57a-47f7-af5e-567dedc0b6d4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.647791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604e0d-f57a-47f7-af5e-567dedc0b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.648154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604e0d-f57a-47f7-af5e-567dedc0b6d4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.649452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 294/593] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:23.651924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604e0d-f57a-47f7-af5e-567dedc0b6d4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.770046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:23.774506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385c03-4289-4100-b498-a7509132ca30 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.781116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604e0d-f57a-47f7-af5e-567dedc0b6d4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:23.784792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:23.822366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.823350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.823644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.823969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.824708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:23.825327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.826420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.840844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:23.841778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.842221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 300/594] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:23.843070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:23.846402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.846730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.857263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:23.858776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c77f662a-0039-40ba-8b95-8ac10fa89962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:23.873721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:23.875153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 295/595] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:23.876648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:23.877387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:23.902207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:23.903420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:24.003800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 296/596] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:24.004044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75651326-40fb-4a71-afca-90ef88a027cd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.004132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.037345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.038029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.038310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.038585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.039326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:24.039634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.041755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.061243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 301/597] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:24.061243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.085764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:24.135613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:24.145082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4530a-f6e6-428c-8397-606df0f58828 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.184948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.185763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.186042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.186321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.194578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.196304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:24.213450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:24.214490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:24.215434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 297/598] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:24.216065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.226584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272240-4c0f-47f1-948f-8cbde618383b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.266098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.266825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.267386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.267667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.268665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:24.269037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.270542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.287913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 302/599] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:24.287913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.343116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747ab72-d97e-429b-976a-ece407272e46 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.379462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:24.381984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.382864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.383152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.383483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.396649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:24.405175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:24.406118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:24.407132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:24.408127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e195e-ce57-4f7a-a6fe-ad6787458de3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.411582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 298/600] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:24.412572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.429882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:24.449597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.450407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.450695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.450975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.465193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.466953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:24.488982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:24.489950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:24.490829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 303/601] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:24.491313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.557750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3a78-e19a-4231-8bd7-b56b0fe91118 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.622161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.623422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.624290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.625066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.626154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:24.626775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.626977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b438b-aa92-4671-96bf-052bd5e5d433 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.628898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.656717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 299/602] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:24.656717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.678991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.680609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.681616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.682144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/120533a970c74d98af45911ba7e6a375/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.699346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:24.713867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=120533a970c74d98af45911ba7e6a375, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.716734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.734565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 304/603] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:24 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/120533a970c74d98af45911ba7e6a375/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:24.735789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.772161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:24.807710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924c1ac-47df-4ff7-ac66-b3881c713ac3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.850770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.851481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.851959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.852227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.853133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:24.853537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.855234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.865934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 300/604] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:24.866520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb1b22-ce2c-43f9-805f-c09cb4a2e5c3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:24.867432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:24.908416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:24.909524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:24.910010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:24.910454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:24.911515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:24.912183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:24.913950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:24.935345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 305/605] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:24.936715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.001108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.021132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053afdc1-e44e-41bc-8769-b3bb8a4b3efd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.068608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.069503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edad83-361c-46c7-b38e-b10c0a52268b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.070022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.070456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.070891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.075265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.088081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.090413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.108883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.109737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.110087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.110431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:25.113375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:25.114485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:25.115606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:25.115606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:25.115606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:25.115606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:25.115606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 301/606] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:25.119795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.127175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.129107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:25.150700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:25.151867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:25.152919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:25.152919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:25.152919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:25.152919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:25.155189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 306/607] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:25.155189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.272742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26839c2d-b717-4684-ad43-0b91ca6cbbcc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.284384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.287675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654259e-fb64-46c5-9048-b9cd81b03004 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.323832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337adb9-9122-475f-820b-13276887a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.325264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337adb9-9122-475f-820b-13276887a630 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.325700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337adb9-9122-475f-820b-13276887a630 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.326131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337adb9-9122-475f-820b-13276887a630 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/c06192133f444b13933b7c4a1997e3cb/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.327112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.328024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.328431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.328806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.329806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:25.330172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.331872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.346115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 307/608] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:25.346825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337adb9-9122-475f-820b-13276887a630 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=c06192133f444b13933b7c4a1997e3cb, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.347228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.348755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337adb9-9122-475f-820b-13276887a630 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.373853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 302/609] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:25 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/c06192133f444b13933b7c4a1997e3cb/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:25.375204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337adb9-9122-475f-820b-13276887a630 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.433383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.499544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920faaf-e042-42b2-8c27-b846284b8398 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.520650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337adb9-9122-475f-820b-13276887a630 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.544727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.545808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.546249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.546679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.547599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:25.548213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.550480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201dbd9-1e36-42b5-891f-6a44244ba0ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.571119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 308/610] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:25.573833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36239d-f190-4f1e-a996-e67e9ea1178f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.574291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36239d-f190-4f1e-a996-e67e9ea1178f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.574957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36239d-f190-4f1e-a996-e67e9ea1178f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.576866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.577703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 309/611] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:25.578028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.578520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.578995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.579279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36239d-f190-4f1e-a996-e67e9ea1178f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.587527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.589387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-25d5ac3f-0064-479e-9b0a-9144fe726f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:25.606494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:25.607678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:25.608806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:25.610058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.611328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 303/612] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:25.612872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.613294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.613798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.632949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:25.634378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:25.724835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 304/613] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:25.725501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36239d-f190-4f1e-a996-e67e9ea1178f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.726320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.757096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.776424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.778306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.779481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.780333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.792876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.795561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:25.816161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:25.817511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:25.818802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 310/614] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:25.820366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.879357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70194e9c-147a-4e61-9ac4-a73cd812959b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:25.924614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:25.925684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:25.926403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:25.926855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:25.927973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:25.928466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:25.930463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:25.937980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:25.955793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 305/615] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:25.957421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:25.972454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e90ae-076e-4b40-94a5-cbcb36ed93ea None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.020600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.022517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.023049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.023639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.040871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:26.052478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:26.053463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:26.054302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:26.058759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 311/616] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:26.059996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.086349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:26.110045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfff33-f933-4deb-ac16-08d4e9319b2b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.163009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.164166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.165038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.166108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.167914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:26.168756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.170798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.195435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 306/617] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 08:51:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:26.197427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.208589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb522634-488e-4432-ab01-7b4b5d778dc6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.260194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.261104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.261387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.261658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/98347f8bc43f46b0aa0d6fb38c162885/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.273997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:26.280736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=98347f8bc43f46b0aa0d6fb38c162885, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.283237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.308026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 312/618] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:26 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/98347f8bc43f46b0aa0d6fb38c162885/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:26.311984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.364728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe72db8-ae0f-4818-8c51-60cf84a72f0d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.419280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.421078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.421584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.422089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.423677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:26.424503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.429351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.447066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 307/619] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:26.456653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.470011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:26.561373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45387d69-e9ee-4973-bd19-72f285c82683 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.615699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.617248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.617758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.618234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.633420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.633908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15dc5-7850-422d-8b02-d2e312dcc0e2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.636310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:26.668744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:26.669731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:26.670620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:26.670620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:26.670620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:26.670620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:26.673248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 313/620] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:26.679034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.687006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.688010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.688306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.688590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.706263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.708171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:26.737110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:26.738095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:26.738977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:26.738977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:26.738977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:26.738977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:26.743584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 308/621] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:26.752778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.763295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:26.823326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:26.869212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1b5a-401a-4cb9-bb98-8494eb2c8310 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.893915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f21e-f1f5-47a8-8cb9-99997ca20b89 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:26.914431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.915116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.915446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.915725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.916485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:26.916797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.918216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.937434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:26.938207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:26.938555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:26.938968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:26.939803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:26.940197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:26.941150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 309/622] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:26.941750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:26.948140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:26.956797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 314/623] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:26.962419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:27.130333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a57bf-6a4b-4a4e-a596-dd82781ddbfa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:27.155833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de818b5a-fc0f-4c3a-8313-6b78e36f7745 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:27.164319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:27.176439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:27.209723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:27.210641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.211028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.211327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.212823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:27.213641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.213916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.214183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.229099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:27.230586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:27.231792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:27.233252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:27.255739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:27.256719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:27.257599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:27.266336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:27.268677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:27.271035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 310/624] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:27.272518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 315/625] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:27.272678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:27.275830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:27.431254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfd86-f58e-432f-88af-613f77b11974 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:27.495134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56cb7-8bd4-4615-a3b0-7e6fb89f38aa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:27.512539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:27.513250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.513538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.513818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.514688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:27.515008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:27.516703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4a28-0004-4a86-aaa6-0b2b49ef1da1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:27.550684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:27.551646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.551956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.552230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.553044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:27.553358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:27.554862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810c90-1d01-4967-80c8-27af88871f6d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:27.560627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 316/626] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 08:51:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:27.562074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d8f0e-70d0-4e58-904a-de3f7ad63be6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.562363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d8f0e-70d0-4e58-904a-de3f7ad63be6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.562638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d8f0e-70d0-4e58-904a-de3f7ad63be6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.564212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 317/627] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:27.569361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d8f0e-70d0-4e58-904a-de3f7ad63be6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:27.575219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 311/628] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:27.576814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.577110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.577424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.599237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:27.600546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:27.616232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:27.640228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:27.692206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 312/629] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:27.693509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:27.718255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d8f0e-70d0-4e58-904a-de3f7ad63be6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:27.772708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:27.773362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.773907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.774188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.838717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def02ed-4fb8-438d-83d7-38424fdf9d1a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:27.860835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:27.862668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:27.892280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:27.892542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:27.893222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:27.893504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:27.893789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/d8b00fb60e5e4548a5371831e56ad76b/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:27.914921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=d8b00fb60e5e4548a5371831e56ad76b, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:27.916507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:27.936624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 313/630] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:27 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/d8b00fb60e5e4548a5371831e56ad76b/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:27.937629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:27.968358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.018829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 318/631] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:28.026811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.072543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891326cc-86dc-4db6-bcf9-585a892f3b90 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.114549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.115425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.115715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.116025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.129604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:28.138247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:28.139258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:28.140144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 314/632] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:28.149083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.238531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.247923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858ab7-8aac-4e51-8f19-a8a7b4bf6c05 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.262580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f310c6-dd7d-4138-acf6-93312fd56fa1 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.275441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.294212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.295366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.295904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.296357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.300508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.306187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.306187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.306187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.306187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:28.306187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:28.306187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:28.314620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 315/633] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:28.319265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:28.319921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.321301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:28.346518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:28.347463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:28.348383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:28.348383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:28.348383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:28.348383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:28.350820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 319/634] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:28.356694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.472911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709bc5e-6af8-4b50-9552-babee23ae648 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.488091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb83c9-3d41-473c-b4f8-81f92be49ac7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.514946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.516047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.516534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.517059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.518114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:28.518645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:28.520525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffc28f-dd82-42fb-8cb1-d39572ed05f6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:28.526143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.527484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.527976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.528283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.541269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:28.541704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 320/635] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:28.542005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:28.542959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.545649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5a09-5927-42a2-81e3-6649c7f099b9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.545649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5a09-5927-42a2-81e3-6649c7f099b9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.546199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5a09-5927-42a2-81e3-6649c7f099b9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.548274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 321/636] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:28.549200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5a09-5927-42a2-81e3-6649c7f099b9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d25d14db-ea35-4527-a866-ea5fc3e3c340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:28.562072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:28.563050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:28.563973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:28.563973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:28.563973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:28.563973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:28.563973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 316/637] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:28.564978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.565263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.565540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.590394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.592459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:28.593709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:28.675077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 317/638] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:28.676260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.678298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5a09-5927-42a2-81e3-6649c7f099b9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.721492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.722659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.723260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.723815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.732510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:28.734486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:28.751431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:28.752448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:28.753349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:28.755929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 322/639] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:28.757331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.799581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb55e5-ef51-45b2-a18a-343166cc4674 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.826481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.839075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.839920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.840208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.840484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.841988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:28.841988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:28.843037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:28.856704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 318/640] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:28.857310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.867269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:28.879775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113342d9-a337-410d-b5d2-6e33f961c80c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:28.921664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:28.922632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:28.923014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:28.923909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:28.936547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:28.945128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:28.946361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:28.947340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:28.952151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 323/641] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:28.953367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:28.980376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718d9e-24d6-496b-9620-ecc160c79d02 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.019807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.020821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.021392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.021849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.022923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:29.023411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.025276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.040036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 319/642] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:29.041687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.073175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5ef38-6307-420c-ad73-ef8963f875d7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.089670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:29.112440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.113345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.113698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.114060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.123332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.124955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:29.139986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:29.140974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:29.141980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 324/643] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:29.142663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.156627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63687e9c-36b9-45df-b037-a437988f4f37 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.160348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:29.197325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.198766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.199236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.199692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.200656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:29.201147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.203653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.216902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 320/644] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:29.218585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.260305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0154-cc35-473c-bd14-652741b5207e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.308728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.310020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.310493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.311238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.312367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=12f623ab113a43b791f0180286fa5ac3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:29.313068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.314688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.321619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 325/645] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/role_assignments?user.id=12f623ab113a43b791f0180286fa5ac3&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:29.323134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.387671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c6e9-3457-4e27-9097-f278a1ebfa07 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.393652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:29.442195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:29.451166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.452070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.452382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.452770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.453864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:29.454335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.456046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dca60c-619a-48a8-a059-31b288d057a6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.475156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c353b3-d829-45ec-8fe7-a496f7ca4ab2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.480129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 321/646] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:29.481321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90302206-a90c-443e-a872-0d39d7ab6e6b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.481611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90302206-a90c-443e-a872-0d39d7ab6e6b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.481911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90302206-a90c-443e-a872-0d39d7ab6e6b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.483692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 322/647] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:29.490450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.490938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.491421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.518188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.519286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.519729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.520190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.522275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:29.525774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:29.535847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.537652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:29.558139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:29.559308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:29.560335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:29.560335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:29.560335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:29.560335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:29.561963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 326/648] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:29.562983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.613802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 323/649] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:29.614687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.700539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535364-215f-4fa7-8c0b-44a305800159 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.743825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:29.752386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:29.760661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.761330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.761632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.761884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.769418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6acbf8-6b3c-4bae-bcf4-723cda278be6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.831692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:29.833070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:29.834058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:29.834820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:29.836054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:29.836601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.839545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.847972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:29.849607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:29.856981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 324/650] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:29.858296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:29.981620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54ef42-d416-450a-af6d-57d7ee35d049 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:29.988350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 327/651] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:29.989554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.025218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.026129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.026477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.026816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.032636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.041056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:30.049457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:30.050482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:30.051585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:30.056577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 325/652] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:30.057615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.077088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.132983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f613bb-65c2-4e4d-86dc-1ee827eadec1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.170576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1cc72-6a0e-4e0a-bab9-fd12be41d629 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.173995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.175012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.175453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.176188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.186165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.188064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:30.205505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:30.206700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:51:30.207902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:30.210332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 328/653] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:30.211272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.211521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.212334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.212709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.213016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.226323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.228052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:30.247576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:30.248557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:30.249643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:30.249643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:30.249643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:30.249643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:30.254363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 326/654] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:30.255369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.328372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.334085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.350368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f6045-8be2-4c6a-8e7e-99360952a54c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.382826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b93ac-59c4-4bec-8d5a-f5d9c2d75f3f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.403897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.405550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.406026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.406766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.407987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:30.408943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.410912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.423172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 329/655] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:30.424647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.428365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.429109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.429347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.429685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.431875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:30.431875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.433385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.458574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 327/656] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:30.459574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.548932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089613-ed0a-4611-84cf-b55bc7cbb99f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.586408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.587119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.587437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.587665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.588423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:30.588728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.590121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.590321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28ca3d-40fc-485e-996b-69c93ee05823 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.609532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 330/657] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:30.610485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.617310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.628324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.633261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.634424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.634947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.635411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.647206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.649043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:30.669574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:30.670526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:30.671410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:30.671410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:30.671410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:30.671410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:30.673589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 328/658] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:30.674567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.728404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf46d5-d9c5-4602-b176-11d35098a7e6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.765698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.766534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.766881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.767223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.791414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851701-978d-4dec-ac62-90159bce6c55 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:30.831022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:30.832121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:30.832615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:30.833092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:30.844068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.844617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:30.845607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.846569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:30.866968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:30.867971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:30.868929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:30.872528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 329/659] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:30.873712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:30.880372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.923885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:30.995265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 331/660] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:30.996235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.016794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafff30-3455-495c-bb08-08bed4017140 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.060172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.060855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.061142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.061428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.062177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:31.062489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.063988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181aab8-1a01-4aab-8943-0a497945fccc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.084122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 330/661] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:31.084122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e6d7-d7e7-42ee-aed1-c84901147c7a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.084122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e6d7-d7e7-42ee-aed1-c84901147c7a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.084122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e6d7-d7e7-42ee-aed1-c84901147c7a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.084122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 331/662] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:31.084122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e6d7-d7e7-42ee-aed1-c84901147c7a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.127158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3ece-07cb-4060-8ae8-0386a26b7d5d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.148300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:31.177863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.178534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.178814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.179084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.179910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:31.180218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.181735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.202649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 332/663] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:31.202649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.232507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:31.242716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e6d7-d7e7-42ee-aed1-c84901147c7a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.306582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.308194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.308825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.309453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.329293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.332383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bcd728ba-a7ed-4c6f-9dcb-81e88a8f903e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:31.366401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:31.367449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:31.368621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:31.368621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:31.368621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:31.368621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:31.374486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 332/664] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:31.374486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.374486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.374486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.383526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed533-1aa9-4a74-ae2e-0a9ce7cf3c53 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.393089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:31.394531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:31.433429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.434299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.434648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.434918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.443333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.444879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:31.460636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:31.462168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:31.463101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 333/665] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:31.463843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.483559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 333/666] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:31.496556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.514223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:31.614349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:31.615482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced0366-5454-41ee-9eb9-3412f783127e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.648434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29ab45-b9c3-425d-a6d9-9503e480c401 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.663119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.664228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.664691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.665310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.667017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=120533a970c74d98af45911ba7e6a375) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:31.667719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.669555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.677345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 334/667] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/role_assignments?user.id=120533a970c74d98af45911ba7e6a375&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:31.678564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.699866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.701125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.701598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.702194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.703232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:31.703844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.705940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.726485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 334/668] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:31.727727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.822863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:31.839590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b01d7-7666-483a-9369-a2fea6c3913d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.882737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.883478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.883736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.884205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.885267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:31.885385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:31.886868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:31.888635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2723477-985a-49e4-8a1a-c2e801e18299 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:31.907968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 335/669] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:31.908836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:31.943832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:31.945035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:31.945314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:31.945584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:31.949068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:31.958857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:31.967434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:31.968476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:31.969454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:31.972098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 335/670] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:31.972930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:32.051706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb3f98-bbf7-4e2d-af70-79d14f4b55ce None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:32.102233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:32.102479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.103285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.103486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.106236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc66c-8a7d-4ef6-9f8c-6ae9defa4b7a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:32.111295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:32.112930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e05fb21c-1cd1-47d9-a08a-45234920a679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:32.128933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:32.129945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:32.130839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 336/671] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:32.131843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b97e-48f5-4523-a24b-4487559f741c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.131951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b97e-48f5-4523-a24b-4487559f741c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.132190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b97e-48f5-4523-a24b-4487559f741c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.133803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 337/672] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:32.138885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b97e-48f5-4523-a24b-4487559f741c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:32.159467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:32.161424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:32.161746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.162361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.162361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.253415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:32.265489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:32.266898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:32.294225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b97e-48f5-4523-a24b-4487559f741c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:32.343519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:32.344869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.345376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.345880 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.347283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:32.347879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:32.350593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee1475-c2e9-403b-8a6a-9deb98f0a840 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:32.367870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 338/673] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:32.370320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.370855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.371347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.396052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:32.397907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:32.463855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 336/674] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:32.465137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:32.492706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 339/675] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:32.493748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:32.510196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:32.661959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29fcd0-b594-4147-a8e0-530107bf7810 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:32.665439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:32.677797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6974af7-6ec5-4538-b3ff-3e87de5864d6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:32.724949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:32.726235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.726729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.727220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.745887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:32.746774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:32.747037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:32.747560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:32.748252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:32.749428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:32.749824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:32.750392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:32.752827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:32.775816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 337/676] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:32.777138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:32.781295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:32.783283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:32.785249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:32.785249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:32.785249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:32.785249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:32.785249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 340/677] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:32.785806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:32.874019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:32.950657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3cb31-197c-4b5f-b006-f9c7b3900804 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:32.952638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d001df-8d6e-4585-a6cf-d730251ec597 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.009556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.011363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.012187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.012797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.015912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.017004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.017471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.017578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.030177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.031680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.034019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.037338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:33.052882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:33.063958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:33.065787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:33.065787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:33.065787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:33.065787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:33.065787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 341/678] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:33.065787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:33.066469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:33.073310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:33.076322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:33.076322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:33.076322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:33.076322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:33.076322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 338/679] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:33.076322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.081272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:33.222144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a58f66-e314-445a-8505-bc2ff1d42cb9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.229089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d912-ddf5-4f44-9931-c91deac8ea78 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.248372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:33.279493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.280651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.281111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.281567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.282813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:33.283328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.285909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.287617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.288537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.288664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.288894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.289759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=c06192133f444b13933b7c4a1997e3cb) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:33.290600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.292174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.307814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 342/680] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/role_assignments?user.id=c06192133f444b13933b7c4a1997e3cb&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:33.307814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.326295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 339/681] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:33.327988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.453191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:33.473068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb702-7638-41af-bad4-7929f38c5651 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.513588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05aab-152a-4b64-8422-6a23d9f34f32 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.527856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.529306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.529936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.530789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.532599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:33.533212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.536137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.556176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 343/682] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:33.557164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.561932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.562733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.563015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.563290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.564076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:33.564384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.565890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.590244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 340/683] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:33.591233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.610644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:33.719593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797727c-78a9-4e4d-8190-766ee9ca6c7b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.728894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c459121-c1f0-46ca-ad8e-3ae9a58ead3d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:33.764599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.765451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.765733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.766040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.766429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:33.776053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.776373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:33.776992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:33.777279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:33.777567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:33.777670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.778293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:33.780043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:33.798394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:33.799473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:33.800467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:33.804982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 344/684] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:33.806563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:33.824864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 341/685] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:51:33 2022] POST /identity/v3/users => generated 254 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:33.825960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.058305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:34.078534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb678-48bc-4e14-b8d5-7295042a5ef7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.083802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ff0f0-1035-4077-80f6-fe97e8c050c2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.143397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:34.148989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.149306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.149605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.151117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:34.151444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:34.153576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:34.160711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:34.161640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.161924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.162326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.172401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:34.173898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7b5d4328-03b8-4e83-a3eb-e6ae7ab9cb31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:34.192123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:34.193254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:34.194159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 345/686] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:34.195229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcad1c-5a4b-40fe-a75e-c8a69db6f79b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.195337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcad1c-5a4b-40fe-a75e-c8a69db6f79b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.196004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcad1c-5a4b-40fe-a75e-c8a69db6f79b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.199746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 342/687] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 08:51:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:34.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 346/688] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:34.203899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.207660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09b317-6997-46b3-b964-85369e224575 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.208111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09b317-6997-46b3-b964-85369e224575 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.208545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09b317-6997-46b3-b964-85369e224575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.241365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9b09b317-6997-46b3-b964-85369e224575 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:34.244733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b09b317-6997-46b3-b964-85369e224575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:34.272234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:34.343951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 347/689] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:34.344734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09b317-6997-46b3-b964-85369e224575 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.382419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a881ec-3c5a-43b5-a88a-3007e8749cfa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.428453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:34.429174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.429458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.429735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.430541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:34.430891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:34.433668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:34.447724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 343/690] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:34.448544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.486027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:34.511444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09b317-6997-46b3-b964-85369e224575 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.564617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:34.565443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.565765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.566007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.574937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20f05-fab0-4172-aa3c-1b12f8b2b51e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.577091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:34.617402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:34.618642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.619152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.619627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.632035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:34.640230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:34.641242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:34.642068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:34.644901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 344/691] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:34.646061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.653091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:34.654172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:34.751310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:34.768669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8c07e-f89f-4a8e-be22-7bfc7971f28e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.778206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 348/692] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:34.778206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.815811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:34.816897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:34.817408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:34.817908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:34.818983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=98347f8bc43f46b0aa0d6fb38c162885) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:34.819519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:34.822459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:34.832136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 345/693] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:34 2022] GET /identity/v3/role_assignments?user.id=98347f8bc43f46b0aa0d6fb38c162885&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:34.833374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:34.872489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:34.946202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d71d22-f017-4681-b5f3-3b9db84bad70 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:34.977310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c96d2f-4ef3-4b62-b520-b34ce84ec0bf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:35.024294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.025915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.026433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.027351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.042188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.044111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:35.065913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:35.066900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:35.067840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:35.067840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:35.067840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:35.067840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:35.070151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 346/694] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:35.075964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:35.081072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.082118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.082611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.083054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.084462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:35.084987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.087633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.122917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 349/695] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:35.128697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:35.180959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:35.209627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d6f33-56b3-4a43-887c-386fa7fd852c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:35.240244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:35.260871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.262477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.263008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.263707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.264896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:35.265376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.267188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.284727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 347/696] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:35.291152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:35.370244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76525632-6121-4ea8-af09-3f9802e43b28 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:35.425093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22870e-d23a-4f9d-a94d-1d664af996b6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:35.445323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.446450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.446909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.447498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.462737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.464551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:35.487360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:35.488498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:35.489513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:35.489513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:35.489513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:35.489513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:35.491791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 350/697] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:35.497185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:35.497835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.499374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.501249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.502584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.518976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.522033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.528503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:35.555277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:35.556338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:35.557255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:35.558767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 348/698] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:35.568626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:35.716922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:35.728695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258577-54b3-4cc0-b3a8-0142417adb8a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:35.815270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.816464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.816969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.817470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.818894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:35.819462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.825819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.854130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 351/699] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:35.861635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:35.870174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07125a73-e852-477e-97c1-97361da5f9cb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:35.914775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:35.915515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:35.915835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:35.916122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:35.916934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:35.917252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:35.919382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:35.935443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 349/700] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:35.940979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:36.023789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:36.073084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842b9da-d692-45cb-b15e-6a425f9acd61 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.095385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b73a-3b64-49f4-88ad-0c4507542a34 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.110677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.111445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.111824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.112173 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.113098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=d8b00fb60e5e4548a5371831e56ad76b) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:36.113484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.115069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aa916-501a-4b87-acc9-a8d52912e407 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.122706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 350/701] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/role_assignments?user.id=d8b00fb60e5e4548a5371831e56ad76b&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:36.124509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced2558-80cf-4aba-8055-8c722b5c9985 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.124882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced2558-80cf-4aba-8055-8c722b5c9985 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.125228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced2558-80cf-4aba-8055-8c722b5c9985 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.131138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 351/702] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:36.132825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.133295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.133845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.143380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.145404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.145693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.150789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.164202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:36.165646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:36.169206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.170726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:36.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:36.202593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:36.203635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:36.204968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 352/703] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:51:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:36.211176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:36.253537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:36.339599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 352/704] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:36.362421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:36.391676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f2362-fa2f-41f1-9953-eecb69fd26f8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.429131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:36.453469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.454965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.455898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.456675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.458516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:36.459076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.461151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.483828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70df8-1dce-4c8a-8bb2-4f29bf8af06a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.491855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 353/705] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:51:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:36.498050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:36.526049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.526829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.527083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.527360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.528072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.529518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:36.545134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:36.546410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:36.549280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 353/706] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jun 3 08:51:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:36.552906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:36.644402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:36.680933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9e40c-a7e6-48a2-a98f-574a5f3af65b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.722830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48b9d-3301-474e-ab83-536cc4887afe None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.728847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.729838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.730327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.730801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.743709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:36.766896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.767591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.767911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.768189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.768919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:36.769225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.771222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.778592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 354/707] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 08:51:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:36.784479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:36.848096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.850501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.895721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524781-e429-4ccb-a303-5c12861f769f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:36.934377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:36.935069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:36.935353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:36.935627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:36.936374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:36.936680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:36.938104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:36.944750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 355/708] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 08:51:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:36.945165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:36.993614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 354/709] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:36.999542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:37.072407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:37.139882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daa607-b33a-4c9c-ac20-6ae9887c1fbd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:37.180350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:37.181247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:37.181539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:37.181805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:37.195083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:37.197382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-03c34117-d11e-431e-8919-079ad47dc5dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:37.217404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:37.218416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:37.219954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:37.219954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:37.219954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:37.219954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:37.219954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 356/710] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:37.224494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:37.251951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748059c-5251-4457-9c51-985729aa8b25 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:37.253104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748059c-5251-4457-9c51-985729aa8b25 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:37.253611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748059c-5251-4457-9c51-985729aa8b25 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:37.256068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 357/711] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:37.263548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:37.264522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:37.265298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:37.292427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:37.294030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:37.440655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 358/712] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:37.474830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b1ab-803b-4ab8-b39f-99ae3142da24 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:37.491949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:37.557114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:37.572606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:37.573305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:37.573592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:37.573867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:37.574610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:37.574918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:37.576371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:37.606492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 355/713] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:37.611292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:37.655564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050ad7e-d77a-488f-899b-9a3ff3f1de9e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:37.704294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:37.705579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:37.706095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:37.706576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:37.719475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:37.729993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:37.731095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:37.731957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:37.734883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 359/714] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:37.735425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:37.741083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:37.848182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:37.862219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52bee-53e7-4c3a-aacc-b33e1ad6d9cc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:37.901251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:37.902766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:37.903264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:37.903791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:37.904755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:37.905268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:37.906902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:37.918517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 360/715] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:37.926202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:37.966056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e1b0-4b26-42b3-a9b1-82d7f70f6c0e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.051884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.052748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.053045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.053313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.070327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376617f-40cc-43f4-886f-7f4909e6e680 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.073152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.074813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.110023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.111216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.111732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.112268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:38.114783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:38.115695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:38.117324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 356/716] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 505 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:38.122430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:38.129997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.131859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.141865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6723428b-3fed-4c1d-b0d4-67886ed5bb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:38.153951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:38.155419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:38.156386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:38.156386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:38.156386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:38.156386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:38.160700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 361/717] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:38.160700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f415a3-d2c4-4152-ab58-7e51655cca85 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.160700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f415a3-d2c4-4152-ab58-7e51655cca85 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.160700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f415a3-d2c4-4152-ab58-7e51655cca85 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.160700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 362/718] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:38.163622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f415a3-d2c4-4152-ab58-7e51655cca85 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:38.254443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:38.261780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e6be7-d188-4dd9-b35c-54a522298481 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.289977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f415a3-d2c4-4152-ab58-7e51655cca85 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.302504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.303661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.303836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.304181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.305106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:38.305608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.307346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6937296-57e3-4bbd-80e5-2d66880612c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.322294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 357/719] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:38.324224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.324638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.325036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.333927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.334862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.335321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.335746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.336652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:38.337709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.339396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.345160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:38.346627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:38.359522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 363/720] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:38.360913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:38.428761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 358/721] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:38.434067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:38.437206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:38.487221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790677ae-1da9-417b-a2c2-c2de04ba4f83 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.531706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.533022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.533703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.534231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.535304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=120533a970c74d98af45911ba7e6a375) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:38.535873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.537590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.549336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 364/722] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/role_assignments?user.id=120533a970c74d98af45911ba7e6a375&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:38.550234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:38.552472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:38.571068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c41bd-63d8-430c-bf77-33627a009785 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.631803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.633332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.634376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.634872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.650686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.653248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:38.681088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:38.683034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:38.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 359/723] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:38.694839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:38.765314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef3b4-6d1c-4e9a-9cc1-ce2237a1c705 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:38.836160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:38.858768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:38.860820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:38.861292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:38.861975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] PATH_INFO: `/v3/services/network` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:38.864388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:38.865921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:38.896600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:38.898779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:38.901033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 365/724] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:38.905604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:39.006283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc4d5-0bfd-4f14-a16b-c35b6acad8da None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:39.085748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:39.086960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.087447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.087955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.089107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:39.089775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:39.091585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:39.124336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8580b1-a350-485d-bcfd-91af20453e00 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:39.138259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 360/725] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:39.144879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:39.154166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:39.202058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:39.203201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.205435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.205939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.211061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] RBAC: Adding query filter params (name=network) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:39.213693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:39.222954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:39.240164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 366/726] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:51:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:39.244847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:39.389922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:39.421136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfc6a9-03aa-44fe-9878-85a2e202bf88 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:39.478623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6bc60-2768-4c1f-a2d5-e5707a2db684 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:39.502115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d802b-fb46-45db-8bee-f91ea85e3279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:39.503385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d802b-fb46-45db-8bee-f91ea85e3279 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.504644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d802b-fb46-45db-8bee-f91ea85e3279 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.505327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d802b-fb46-45db-8bee-f91ea85e3279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.555336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:39.559584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.560811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.561354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.562775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] RBAC: Adding query filter params (type=network) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:39.563658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:39.565605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c5b8e-5a42-40ba-bf7d-d1c69629de1a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:39.574331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 367/727] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:51:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:39.576165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811b74c-55b7-4e98-9a04-eac5b3276e8e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.576690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811b74c-55b7-4e98-9a04-eac5b3276e8e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.577181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811b74c-55b7-4e98-9a04-eac5b3276e8e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.579192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 368/728] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:39.588453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.589144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.589951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.625763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:39.636144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:39.638070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d802b-fb46-45db-8bee-f91ea85e3279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:39.639846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d802b-fb46-45db-8bee-f91ea85e3279 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:39.644290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:39.738878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 369/729] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:39.779677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:39.851530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 361/730] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:39.853654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc629f9-bdb3-4ff3-81e3-3a49a32bb4c3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:39.854074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc629f9-bdb3-4ff3-81e3-3a49a32bb4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:39.854357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc629f9-bdb3-4ff3-81e3-3a49a32bb4c3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:39.856016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 362/731] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:39.865341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc629f9-bdb3-4ff3-81e3-3a49a32bb4c3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:39.867926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:39.993842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d6e77-c07b-4830-aea8-50124810dce7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.056148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f31bc-e51e-4f77-9298-150b01533c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.056980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f31bc-e51e-4f77-9298-150b01533c9d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.057260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f31bc-e51e-4f77-9298-150b01533c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.057532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f31bc-e51e-4f77-9298-150b01533c9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.072631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f31bc-e51e-4f77-9298-150b01533c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:40.073726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc629f9-bdb3-4ff3-81e3-3a49a32bb4c3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.076661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-342f31bc-e51e-4f77-9298-150b01533c9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:40.081872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:40.083853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 370/732] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:40.085375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.088018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.088018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.110238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:40.112148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:40.123529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.124483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.124768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.125108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.138770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.140389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:40.161096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:40.162058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:40.162960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:40.162960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:40.162960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:40.162960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:40.166996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 363/733] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:40.167933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.200723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 371/734] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:40.202099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.243976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:40.334478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b611-9968-441a-b900-d4439a4b0e13 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.341166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdabf5-4495-46b9-bf79-fe54510f1e7b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.376883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.378079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.378610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.379142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.380108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:40.380711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.382587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.388064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.388883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.389241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.389589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.390428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:40.390809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.392632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.406674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 364/735] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:40.406674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.407430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 372/736] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:40.408710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.426986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:40.512508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:40.519166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d91e4-7a42-49bb-9235-6c9b38be46ff None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.523679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105aab-2081-48bb-9b41-e6b42f4e854c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.559873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.562091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.562614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.563101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.567794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.568487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.568777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.569054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.569896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.571223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.572958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.574636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.595779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 365/737] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:51:40 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:40.595779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:40.600623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:40.601488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:40.602428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:40.612256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 373/738] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:40.613557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.692420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:40.737462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d4ca9-28e9-4bb2-a096-b90f8b3e4411 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.766088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe887d5-034f-4780-bb0c-118d95c8dce5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.780041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.781261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.781713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.782143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.795490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.797457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:40.819061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:40.820072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:40.820984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:40.820984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:40.820984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:40.820984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:40.824593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 366/739] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:40.830877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.838690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:40.840020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:40.840612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:40.841204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:40.843480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:40.843480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:40.846952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:40.895041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 374/740] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:40.905967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:40.949685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:40.960155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c519c0a-ade9-4895-ab42-cb38d4283d4e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:40.988671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:41.003988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:41.005029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.005564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.006040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.006971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:41.007459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:41.010619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:41.027249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 367/741] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:41.034019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:41.128651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96e2e-43ec-4cc1-9fd4-85a706d9caee None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:41.153953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8b80f-c3d6-465c-9c0d-c8b2fd21b699 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:41.194513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:41.195791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.196788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.197324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.198448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:41.199904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.200418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.201602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.203003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=8294ae6c597b4a198312fb562357bf72) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:41.203707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:41.206662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:41.206886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:41.208514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:41.218898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 375/742] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:40 2022] GET /identity/v3/role_assignments?user.id=8294ae6c597b4a198312fb562357bf72&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:41.224876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:41.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:41.227130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:41.229475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 368/743] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:41.235404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:41.341877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:41.365597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a852fa-2dd9-4a17-a2fe-264dcaaaeba3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:41.423424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:41.424481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.424919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.425343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.426617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:41.427091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:41.428800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7dceb-2ead-4143-a6c4-a441458104ab None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:41.455325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 376/744] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 08:51:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:41.461199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:41.516562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:41.580513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd44e37-ea57-4be0-83c8-a472826be058 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:41.621616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:41.622551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.622986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.623454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.703657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:41.705468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:41.759908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:41.761554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ef82-d4f7-4666-950c-4bc4408e1cb9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.761847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ef82-d4f7-4666-950c-4bc4408e1cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.762126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ef82-d4f7-4666-950c-4bc4408e1cb9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.764029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 377/745] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:41.783602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:41.784083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:41.784463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:41.819927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:41.821433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:41.836904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 369/746] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 08:51:41.848249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:41.922270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 378/747] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:41.959851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.025041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3def05c-54d2-4724-af60-0107967bcf15 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.073958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.074785 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.075067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.075342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.098909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:42.098909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:42.105548 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:42.129992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:42.131159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:42.132263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:42.132263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:42.132263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:42.132263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:42.132263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 370/748] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:42.137769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.176414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:42.228461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335562-93e8-4e60-9888-e5434d3e5fcb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.317644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850431a-770a-492e-addd-c61460d81699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.318475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850431a-770a-492e-addd-c61460d81699 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.318760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850431a-770a-492e-addd-c61460d81699 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.319038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850431a-770a-492e-addd-c61460d81699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.347460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850431a-770a-492e-addd-c61460d81699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e850431a-770a-492e-addd-c61460d81699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:42.365475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:42.367038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:42.369779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 379/749] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:42.379152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664f530-17f0-4eb9-a78d-5011429f743f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.392824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850431a-770a-492e-addd-c61460d81699 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.453215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.454725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.455648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.456162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.457383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:42.457923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:42.460459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea4f62-9dd0-4c4f-a55f-ac270660a02d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:42.478635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 371/750] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:42.480446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a91cfe-5543-4f4a-9d21-809c9fc15814 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.480974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a91cfe-5543-4f4a-9d21-809c9fc15814 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.481455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a91cfe-5543-4f4a-9d21-809c9fc15814 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.483511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 372/751] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:42.484515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a91cfe-5543-4f4a-9d21-809c9fc15814 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.528351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850431a-770a-492e-addd-c61460d81699 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.561747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:42.570857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.572296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.572598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.572877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.573786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:42.574341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:42.575505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:42.576415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9faae-0053-4b8a-a161-f35657c79cec None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:42.586324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 380/752] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:42.588463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.588756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.589036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.607232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:42.608454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:42.656365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a91cfe-5543-4f4a-9d21-809c9fc15814 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.707162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.708654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.709478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.715793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 381/753] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 08:51:42.715793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.717265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.733380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:42.736716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:42.757052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:42.758182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:42.759873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:42.762104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 373/754] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:42.767456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.862206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49994-b5b1-4e0d-adab-685d97e461ad None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.886089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c673a6-73d4-49d9-838c-90b5684aa418 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:42.888116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:42.904372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.905190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.905472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.905747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.910776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:42.919668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:42.921487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:42.935023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:42.936111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:42.936591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:42.937079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:42.938003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:42.939587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:42.941704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:42.942609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:42.943569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:42.943569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:42.943569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:42.943569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:42.943569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 382/755] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:42.944197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:42.968434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 374/756] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:51:42 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:42.968434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:43.134801 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee03bc-1904-41b9-95e0-193ae1e6b483 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:43.213845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:43.214622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.214789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.215060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.215887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:43.216201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:43.217819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:43.230539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153982a0-3ed0-4b5c-89b6-7392f4633228 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:43.247691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 383/757] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:43.253235 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:43.299105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:43.308796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:43.310041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.310527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.311026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.312131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:43.312678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:43.314371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:43.333020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 375/758] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:43.338854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:43.379491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:43.384579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a8ce-6f62-49f5-a2d8-122969a7af02 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:43.429373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:43.430133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.430462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.430753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.431671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=d8b00fb60e5e4548a5371831e56ad76b) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:43.432021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:43.433576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:43.440839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 384/759] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:43 2022] GET /identity/v3/role_assignments?user.id=d8b00fb60e5e4548a5371831e56ad76b&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:43.472508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633063aa-9242-4999-9a74-74429aa80265 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:43.540896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:43.541783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.542069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.542395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.557050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:43.558573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c8e1e948-a085-4e37-8408-4eb694d05ab6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:43.581371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:43.582454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:43.583385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 376/760] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:51:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:43.590800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:43.735152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:43.749078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ff71-34fb-4e0d-900d-eaa8ebcb37ce None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:43.789134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:43.789878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.790648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.790979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.791797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:43.792123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:43.793570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:43.819559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 385/761] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:51:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:43.821767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d626f4d-0a3a-4483-8866-9dd0e643c863 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.822059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d626f4d-0a3a-4483-8866-9dd0e643c863 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.822339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d626f4d-0a3a-4483-8866-9dd0e643c863 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.826068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 377/762] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:43.826389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:43.830767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.831295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.833882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:43.852873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:43.854835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:43.935217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314b77-114a-4d4d-9f09-3386ac5ab0c2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:43.961287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 378/763] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:43.994542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:43.995376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:43.995665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:43.995971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.011237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.012772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.020122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:44.038273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:44.039390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:44.040603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:44.040603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:44.040603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:44.040603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:44.040603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 386/764] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:44.047388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.071900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.085586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.173476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37fb98-f016-484b-a00e-f2f745983840 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.177950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9845eb6-0b23-42ea-978b-2a8800b732bd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.211064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.212071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.212355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.212623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.213282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.214455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.214915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.215130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.215406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.215681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.216443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:44.216752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.218148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489d315-bfc9-43c0-b3cc-1eb5080eb55f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-91a413b8-2dda-4529-831c-e445be692fdf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:44.229851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:44.230847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:44.231690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 379/765] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:44.233165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c638-48ab-4f69-bd8b-df60e3842bad None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.233165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c638-48ab-4f69-bd8b-df60e3842bad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.233461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c638-48ab-4f69-bd8b-df60e3842bad None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.239777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 380/766] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:44.240042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 387/767] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:44.240213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c638-48ab-4f69-bd8b-df60e3842bad None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.240820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.241113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.241391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.259959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:44.261159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:44.322813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.335619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 388/768] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:44.336709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.345617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.360767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c638-48ab-4f69-bd8b-df60e3842bad None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.401925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.403367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.403953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.404404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.405373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:44.405857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.407437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.413484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 381/769] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:44.419306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.448040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a1e60-66e2-4330-8cc9-7301dbe9e698 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.485786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.486617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.487325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.487614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.497971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.499722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:44.514810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:44.515792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:44.516676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:44.523704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 389/770] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:44.525442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.549214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127166-c0a6-4fb8-8c8b-95e927a1ab9a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.586076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.601780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.602630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.602911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.603192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.617401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:44.626162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:44.627115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:44.627986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 382/771] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:44.628693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.647811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.656821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb80d8-869d-4001-88e1-25cd236da56b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.704934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.705613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.706158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.706439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.708081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:44.708397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.709878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.717935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 390/772] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:44.718776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.740366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c156fb-bc2e-4207-b168-eea187511e57 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.785862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.786846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.787402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.787685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.788848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:44.789163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.791367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.808811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 383/773] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:44.810068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.834838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51bd33-12a8-43eb-af84-e2c81fcad261 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.859677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.884626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.885305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.885589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.885866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.886618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:44.886928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.888365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:44.897172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 391/774] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:44.898393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:44.914951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:44.943092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990978-cb13-4388-a0d4-66480d7beb1a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:44.990389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:44.991119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:44.991406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:44.991733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:44.992576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] RBAC: Adding query filter params (interface=public, service_id=1afe66158c58473585fdf829b424a63a, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:44.993424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:44.994836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.005538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 384/775] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:51:44 2022] GET /identity/v3/endpoints?service_id=1afe66158c58473585fdf829b424a63a&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:45.006818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:45.032484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d34d-18b9-411b-b22e-ea732139cc9f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:45.069101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:45.069877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.070162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.070436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/120533a970c74d98af45911ba7e6a375/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.073085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=120533a970c74d98af45911ba7e6a375, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:45.074540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.091266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 392/776] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:44 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/120533a970c74d98af45911ba7e6a375/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:45.092332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:45.122967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71f53-bab6-498d-a5c6-376834eaf207 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:45.141025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:45.162795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:45.164031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.164518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.165056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.173082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:45.179323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:45.181670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:45.200836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:45.201842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:45.202814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:45.202814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:45.202814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:45.202814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:45.205105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 385/777] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:45.219539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbcaae-706a-4def-86a3-ba810f1eb233 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:45.221208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:45.259395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:45.260123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.260409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.260678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.261392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:45.262777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.269082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 393/778] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:51:45 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:45.372754 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7959cc-3a44-4eed-b8ac-d8fcd2bb9da6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:45.419579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:45.421063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.421503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.421924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.422843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:45.423304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:45.425908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.441977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 386/779] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:45.451947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:45.584120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48171-a8a4-4a84-a2f6-be896e69b628 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:45.585997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:45.624983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:45.625825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.626111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.626387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.635147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:45.636648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:45.652837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:45.653875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:45.654807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:45.655873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 394/780] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:51:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:45.660897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:45.723642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:45.794589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5c522-0e75-48a5-9254-2958983cdc19 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:45.841072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:45.841768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.842050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.842328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.843170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:45.843484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:45.844990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff9bb6-26c5-4f9d-b530-ccc0101cd0ba None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:45.868256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 387/781] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 08:51:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:45.876861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:45.924058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dbb5-9749-41a0-82dc-e22e89ef91fb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.924420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dbb5-9749-41a0-82dc-e22e89ef91fb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.924809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039dbb5-9749-41a0-82dc-e22e89ef91fb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.927002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 388/782] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:45.932352 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a024-29af-4226-92cc-e20145470ed5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:45.932635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a024-29af-4226-92cc-e20145470ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:45.932910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a024-29af-4226-92cc-e20145470ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:45.966591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cc46a024-29af-4226-92cc-e20145470ed5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:45.968204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cc46a024-29af-4226-92cc-e20145470ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:46.026720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e1d2-70e9-4c0a-a44d-05bf5be9cac5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.063524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.064380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.064660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.064926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.077154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.078732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4b1b98a7-26ea-40ce-bf10-339d1d9bdc47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:46.097679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:46.098665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:46.099980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:46.099980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:46.099980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:46.099980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:46.099980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 395/783] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:46.100285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e67c1-723c-4637-8a00-df347e3307be None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.100602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e67c1-723c-4637-8a00-df347e3307be None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.100700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e67c1-723c-4637-8a00-df347e3307be None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.102138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 396/784] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:46.106725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e67c1-723c-4637-8a00-df347e3307be None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.117502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 389/785] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:46.119104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.119392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.119672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.137511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:46.139425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:46.140904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:46.178646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:46.241604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 390/786] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:46.241604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.269209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e67c1-723c-4637-8a00-df347e3307be None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.317189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.317865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.318149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.318418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.319298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:46.319720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.321673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.341426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 397/787] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:46.341426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.384810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613d3be-9400-4b8b-a123-c2837cb1b9c8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.419621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.420457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.420733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.421014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] PATH_INFO: `/v3/services/network` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.421721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.423028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.431092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:46.436433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:46.437799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:46.438641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 391/788] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:46.439468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.464775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6fc9b-c0ba-4ad9-be2a-4257f0329084 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.480119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:46.504034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.505180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.505668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.506187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.520783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:46.531838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:46.532829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:46.533683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:46.541667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 398/789] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:46.541667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.557007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d23eb-3fd6-49fc-b471-61dbf10e618f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.608003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.610043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.610544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.611023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.625436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.628484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:46.651055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:46.652295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:46.653193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:46.653623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81f839-9327-4df7-8aa2-f90a54fd2024 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.661673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 392/790] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:46.662821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.697919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.699025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.699460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.699895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.700881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] RBAC: Adding query filter params (name=network) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:46.701203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.703300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.709659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 399/791] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:46.710511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.712041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:46.780393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:46.796559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2c0b-cc33-4701-baa2-6dcc988aea9e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.847359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.848135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.848416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.848684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.849512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:46.849823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.851358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.864647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 393/792] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:46.866706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:46.877153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217a3f1-692f-4f09-aefa-8f7c994f773b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:46.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:46.917374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:46.917654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:46.917930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:46.918720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:46.919029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:46.920841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:46.938512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 400/793] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:46.943950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.017612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:47.021409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8c62-e5b5-47ad-b7c4-d8e20dbbbfa3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.069272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.070012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.070300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.070618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.071655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:47.072042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.073646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.087005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 394/794] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:47.087005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.091565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b7404-af63-4e7d-83cc-7a09cc1190db None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.112753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:47.142359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03409221-e304-4da4-8f48-545463c14478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.143181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03409221-e304-4da4-8f48-545463c14478 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.143466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03409221-e304-4da4-8f48-545463c14478 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.143744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03409221-e304-4da4-8f48-545463c14478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.168703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03409221-e304-4da4-8f48-545463c14478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.171700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03409221-e304-4da4-8f48-545463c14478 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-03409221-e304-4da4-8f48-545463c14478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:47.195526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:47.196552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:47.197420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:47.197420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:47.197420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:47.197420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:47.199634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 401/795] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:47.200674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03409221-e304-4da4-8f48-545463c14478 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.218125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb585-e522-4252-994c-40f5a5d6ce61 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.254831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.255787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.256085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.256364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/8294ae6c597b4a198312fb562357bf72/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.272220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=8294ae6c597b4a198312fb562357bf72, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.273755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.300187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 395/796] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:47 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/8294ae6c597b4a198312fb562357bf72/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:47.301420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.314511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03409221-e304-4da4-8f48-545463c14478 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.328708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:47.360859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.362071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.362548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.363139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.364169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] RBAC: Adding query filter params (interface=public, service_id=9a38a7e90f4746938a41a5ea9fba679b, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:47.364686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.366535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.376018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 402/797] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:51:47 2022] GET /identity/v3/endpoints?service_id=9a38a7e90f4746938a41a5ea9fba679b&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:47.381891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.451977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:47.529704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251c2e2-e851-4bf1-b25c-f19d0e6fa866 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.608062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccce2c-89be-4a40-a7b8-78c7ea43a8b2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.609148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.609895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.610186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.610460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.611224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:47.611532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.613006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.632537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 396/798] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:47.640863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.653420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.654478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.654863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.655238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.656060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.657550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.667791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 403/799] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:51:47 2022] GET /identity/v3/services => generated 772 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:47.794565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d1d83-92c4-4cd9-8403-f55f70283f90 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:47.828404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:47.838610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:47.839454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.839734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.840038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.848528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:47.850113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-60024fb4-ca25-437a-ab65-ae682242baa7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:47.865417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:47.866379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:47.867736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 397/800] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:47.872467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:47.875442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a482367-fc4d-490f-91dd-488575e5d52d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.875725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a482367-fc4d-490f-91dd-488575e5d52d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.876027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a482367-fc4d-490f-91dd-488575e5d52d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.877615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 398/801] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:47.892528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb8aae-4b9d-49b8-a68f-22560dcbea22 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:47.892845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb8aae-4b9d-49b8-a68f-22560dcbea22 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:47.893110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb8aae-4b9d-49b8-a68f-22560dcbea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:47.916068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6eeb8aae-4b9d-49b8-a68f-22560dcbea22 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:47.917864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6eeb8aae-4b9d-49b8-a68f-22560dcbea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:47.970633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.013451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 399/802] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:48.014799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181386c-0318-459d-b742-d7aba27b3fe9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.015097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181386c-0318-459d-b742-d7aba27b3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.015378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181386c-0318-459d-b742-d7aba27b3fe9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.016857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 400/803] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:48.025587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.025874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.026160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.053475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:48.054884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c0c3-a0fb-4b1f-922f-606599df8030 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.055828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:48.092495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.093188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.093473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.093798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.094818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:48.094928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.096497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.115966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 404/804] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 08:51:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:48.116845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.154555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 401/805] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:48.155775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.220830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.235214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748e0f-8b0f-4651-be16-bbfb05c85330 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.252284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.281923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.283105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.283775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.284374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.299313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:48.304120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77042e31-f0e1-469c-8419-ea27592b9335 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:48.309978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:48.310970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:48.311831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:48.314698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 405/806] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:48.316270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.355277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.356285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.356630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.356964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.369360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.370994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:48.394753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:48.395728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:48.396646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:48.396646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:48.396646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:48.396646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:48.400181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 402/807] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:48.401110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.459693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23872-e4c3-4131-9ddd-881e282b9386 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.496467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.497332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.497617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.497888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.498538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.499944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:48.512709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:48.513687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 08:51:48.514524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:48.518857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 406/808] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:48.519733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.527840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.533469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8caf7f-2757-43ba-81fc-1845692c3a23 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.545123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.575718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.576768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.577280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.577756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.578808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:48.579335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.581058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.590985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 403/809] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:48.592129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.633916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4513d-cd4b-4fdd-b081-38b5c9840bef None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.670917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.671664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.671963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.672234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.673002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:48.673311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.674730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.692118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 407/810] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:48.693031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.709014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313ce42-2205-41cd-bee1-5385a5691dd0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.748307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.749354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.749868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.750345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.751358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:48.751905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.753600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.759247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 404/811] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:48.760298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.785974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.793162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:48.807312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2d84-1f68-41a5-8a6e-67512cf53ae3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.858848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.858848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.858848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.858848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.881044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.883282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.897501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666c723-b788-4109-82cb-5d320a069ccb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:48.908362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:48.909331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:48.910266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:48.910266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:48.910266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:48.910266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:48.914788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 408/812] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:48.916047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:48.943639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:48.944887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:48.945403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:48.945984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:48.956886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:48.958779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:48.981028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:48.982011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:48.982931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:48.991638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 405/813] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:48.993427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:49.045621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acfcd4-c174-47a6-8d50-e8e5b4c81617 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.079171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:49.085532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.086578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.087088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.087586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.088530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:49.089044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.090629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.097056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:49.101282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 409/814] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:49.103126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:49.116315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa8e93-58ec-482d-b991-62db6c37a960 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.178917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.180904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.181621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.182321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.183872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:49.184689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.187389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.209479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 406/815] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:49.211404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:49.282844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435a72-c991-402b-bd08-844d14b23094 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.347068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.348075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.348425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.348827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.350420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:49.350988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.354378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.377153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 410/816] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:49.378662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:49.390518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27126dc4-97f5-4fb1-9d95-7e6c79953600 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.449494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.451162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.451950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.452676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.454293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.457067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.482536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:49.497470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 407/817] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:51:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:49.498488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:49.503901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:49.578952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bc538-d8e2-4d89-94e1-af8dfbada941 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.646505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.648039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.648555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.649256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.660489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6216deb-85e5-4114-b776-ad8aea695fc5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.661756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.664325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:49.688103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:49.689651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:51:49.690629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:49.694378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 411/818] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:51:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:49.700722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:49.723395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.724358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.724698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.724978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/d8b00fb60e5e4548a5371831e56ad76b/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.728722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=d8b00fb60e5e4548a5371831e56ad76b, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.730215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.757224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 408/819] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:51:49 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/d8b00fb60e5e4548a5371831e56ad76b/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:51:49.859784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33b9e9-03c6-4797-a875-acc3be9d1e51 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:49.877754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:49.905893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:49.906603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:49.906888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:49.907163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:49.908136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:49.908451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:49.909986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c3b3-4ca3-4d48-879e-07efdc20bb57 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:49.936214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 412/820] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:51:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:49.942178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.017168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:50.063051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280e0e-f754-4bf9-b395-08fa68022539 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:50.099474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d324c15-9fe0-458a-9a9c-3da3dffd7fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:50.100179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d324c15-9fe0-458a-9a9c-3da3dffd7fad None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.100536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d324c15-9fe0-458a-9a9c-3da3dffd7fad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.100821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d324c15-9fe0-458a-9a9c-3da3dffd7fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.174741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d324c15-9fe0-458a-9a9c-3da3dffd7fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:50.176567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d324c15-9fe0-458a-9a9c-3da3dffd7fad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:50.189171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee93bf-0c72-4f05-88cb-a1fe89a4e11f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.189487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee93bf-0c72-4f05-88cb-a1fe89a4e11f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.189795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee93bf-0c72-4f05-88cb-a1fe89a4e11f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.191337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 413/821] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:50.197128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661f3fa-6ae0-4252-ac9c-83722019c099 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.197721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661f3fa-6ae0-4252-ac9c-83722019c099 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.198225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661f3fa-6ae0-4252-ac9c-83722019c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.216828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b661f3fa-6ae0-4252-ac9c-83722019c099 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:50.218511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b661f3fa-6ae0-4252-ac9c-83722019c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:50.247305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:50.295736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 409/822] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:51:50.295736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793012d-07c4-4990-b4ee-02ac2fffb4c5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.295736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793012d-07c4-4990-b4ee-02ac2fffb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.295736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793012d-07c4-4990-b4ee-02ac2fffb4c5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.295736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 410/823] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:50.296721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793012d-07c4-4990-b4ee-02ac2fffb4c5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.333546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 414/824] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:50.335817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.336340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.337370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.368312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:50.369999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:50.431932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793012d-07c4-4990-b4ee-02ac2fffb4c5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:50.469323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 415/825] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:50.471287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.479156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:50.480023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.480312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.480586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.495744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:50.497898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:50.506666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:50.525713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:50.526799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:50.527823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:50.527823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:50.527823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:50.527823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:50.527823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 411/826] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:50.528145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.549040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:50.601422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4aa32-fe4b-41ac-a1fe-000fa5b9f7cb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:50.640381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:50.641456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.641884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.642311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.643791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392a9d-5d9e-4803-a681-24852f68c610 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:50.657655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:50.666608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:50.667866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:51:50.668809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:50.670828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 416/827] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:50.676862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.688579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:50.689446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.689733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.690011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.691172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:50.692998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:50.708685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:50.709968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 08:51:50.710844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:50.715594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 412/828] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:50.716554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.802756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:50.815465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe622-c461-445b-a7d2-f987e16cd7e8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:50.816745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:50.843395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c870-0e6a-469e-9ef1-b7040561c9a1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:50.863487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:50.864202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.864522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.865092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.865836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:50.866544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:50.868550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:50.884026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 417/829] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:50.885283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:50.892172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:50.892860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:50.893143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:50.893415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:50.894178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:50.894489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:50.895925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:50.913850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 413/830] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:50.913850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.020539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714879-8b98-45d4-b41b-8513386d1a8b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.039190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf806-336f-488b-a0c6-a8cf512547a7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.073682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.074118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.074409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.074691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.075697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:51.076039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.077717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.083780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.084907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.085407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.085887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.087845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 418/831] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:51.089048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.097380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.099239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.102819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:51.110972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:51.121908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:51.122881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:51.124244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 414/832] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:51.124795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.214341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fff2-09a1-4810-8c66-37813d24eea5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.251814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.252630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.252913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.253186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.254256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16623bd9-d52a-4392-944e-184b98159f22 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.265014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.266502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:51.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:51.286698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:51.287589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:51.287589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:51.287589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:51.287589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:51.292039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 419/833] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:51.293020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.299704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.300991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.301492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.301956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.302962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:51.303482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.305997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.312596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 415/834] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:51.313828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.364828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:51.389551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:51.401643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c3ad-3cb6-42c2-b126-28d370201551 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.436163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683a99-6ec9-4da3-9e25-ea4f1b60da02 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.439589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.439735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.440033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.440314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.441106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:51.441419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.442867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.459850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 420/835] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:51.460815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.477998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.479072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.479563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.480075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.481134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:51.481770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.483430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.499463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 416/836] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:51.500811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.573481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc606209-c2f1-44b9-84f4-4f0f2e0d7270 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.600215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:51.610372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.611068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.611380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.611749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.612562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.614104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.633373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4538-8f96-4507-b06e-3313b75d37a5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.637266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 421/837] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:51:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:51.637831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:51.666056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:51.696774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.698419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.698900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.699389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.700558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=120533a970c74d98af45911ba7e6a375) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:51.701215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.702980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.719091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 417/838] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/role_assignments?user.id=120533a970c74d98af45911ba7e6a375&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:51.783651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18e5eb-8dad-438a-898f-86195046098c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:51.835161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:51.836159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:51.836669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:51.836952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:51.846642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:51.848238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:51.864578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:51.865616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:51.866549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 422/839] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:51.872606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.025742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60212c-1d94-420b-8946-0496601826f6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:52.070232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:52.071321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.071938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.072427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.073501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:52.074050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:52.075831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0cfd-3ca4-496f-a158-3851419975eb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:52.111404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 418/840] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 08:51:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:52.116719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.182135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:52.248217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3100df5-c715-4177-a16a-f9ec99695445 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:52.284706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:52.285434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.285735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.286035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.330616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099ad1c-f54a-4c07-8eb2-36ae66036be3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.330896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099ad1c-f54a-4c07-8eb2-36ae66036be3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.331209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099ad1c-f54a-4c07-8eb2-36ae66036be3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.335901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 419/841] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:52.339467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ccf60-9fc6-439d-b993-32e19c032edf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.339867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ccf60-9fc6-439d-b993-32e19c032edf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.340118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ccf60-9fc6-439d-b993-32e19c032edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.361568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d07ccf60-9fc6-439d-b993-32e19c032edf None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:52.363797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d07ccf60-9fc6-439d-b993-32e19c032edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:52.364336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:52.365869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:52.421064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:52.434751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:52.479125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 420/842] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:52.481791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384d30-604b-4fda-bc57-a8a95f5768ec None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.482413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384d30-604b-4fda-bc57-a8a95f5768ec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.483042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384d30-604b-4fda-bc57-a8a95f5768ec None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.489670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 421/843] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:52.492123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.493177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.493665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.509155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 423/844] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:51:52.510315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.513589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:52.514930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:52.599540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 422/845] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:52.599540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.642740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87688b2-4f1c-46a3-b733-a61ba12cd494 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:52.692273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:52.693492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.693920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.694479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.695142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:52.697169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:52.710967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:52.712564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:51:52.713413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:52.717718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 424/846] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:52.718437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.723005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c333c1-c7a9-4877-a31c-ed444b4550a5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:52.725081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:52.728122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:52.772311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:52.773038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.773321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.773593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.784481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:52.785908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:52.804961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:52.806600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:52.807507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:52.807507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:52.807507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:52.807507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:52.807507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 423/847] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:52.808376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.839133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f8c2a-5796-4049-828c-eda1ba8301f6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:52.878110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:52.878923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.879191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.879462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.901453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:52.909211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:52.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:52.911104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 425/848] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:52.912391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:52.932325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491712bd-a184-44ab-bce8-1dad7f5398e2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:52.976255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:52.976943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:52.977732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:52.978010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:52.978733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:52.979042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:52.980605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:52.988216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 424/849] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:52.989088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.001122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.013213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.038190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d12a69-55a5-4a57-aa6d-a167c444058d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.077093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.077767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.078050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.078333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.079062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:53.079373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.080807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.093227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 426/850] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:53.094075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.113674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2c4b-e8a5-4413-8eaa-d2bf04153016 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.149705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.150381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.150664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.150938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.151693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:53.152032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.153418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.164208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 425/851] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:53.165534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.229336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831f3ff-9792-44ea-a5a9-52a7512f161e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.266106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.267259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.280352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.281040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.281357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.281599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.282307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:53.282635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.284055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.299887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 427/852] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:53.299887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.307024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2edb7c-15ea-4173-a09c-e5179a1718da None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.366331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.368002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.368488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.368837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.379578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.381232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:53.402471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:53.403451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:53.404388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:53.404813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 426/853] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:53.410409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.416058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225f2eb-9cbd-4fd2-a131-e2ca37e3a37a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.463974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.465648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.466159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.466656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.483183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.485685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:53.512616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:53.513574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:53.514450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:53.514450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:53.514450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:53.514450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:53.517240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 428/854] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:53.524458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.554243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0683b87-4e36-438c-ae55-72efc6a60a52 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.598521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.603406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.604275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.604689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.604966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.605761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:53.606234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.608517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.619405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.627856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 427/855] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:53.629726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.647785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14adddd-0c26-49d2-9282-5b467f3ddfe7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.689846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.690742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.691030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.691350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.692359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:53.692681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.694202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.708261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 429/856] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:53.714304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:53.779439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f0bde-3e41-400c-aa73-6383ba6fa79d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.831021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.831641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.832162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.832399 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.833408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=8294ae6c597b4a198312fb562357bf72) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:53.833408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.836735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.845875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 428/857] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/role_assignments?user.id=8294ae6c597b4a198312fb562357bf72&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:53.848221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3053485-2d03-41ac-b3ed-99eebb0f29be None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:53.856748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:53.901501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:53.902379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:53.902669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:53.902943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:53.912754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:53.914253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:53.932088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:53.933948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:53.935831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 430/858] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:53.947796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:54.036236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:54.079956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b9cff-bfc1-4676-835b-fe0bb47c4bd9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:54.119421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:54.120487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.120983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.121465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.122511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:54.123031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:54.124883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee487-672f-4b74-a24f-ced2cb6f9d95 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:54.152194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 429/859] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 08:51:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:54.154250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:54.272443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674635f-ac2e-4038-93c2-b7b31b167591 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:54.318435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:54.319563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.320275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.321020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.359618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:54.384306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b2ac-0430-4ea5-a961-2496bc156884 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.384951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b2ac-0430-4ea5-a961-2496bc156884 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.385420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b2ac-0430-4ea5-a961-2496bc156884 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.386971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 430/860] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:54.399604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.399918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.400251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.417681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:54.419188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:54.431424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:54.433329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:54.548864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 431/861] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:54.550167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 431/862] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:51:54.556347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:54.574005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:54.641798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:54.653006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:54.713295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebce86-e1a8-46dd-965f-216a7e20c5ad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:54.722090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2270fd-2b8b-4580-af63-95085d2b625b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:54.764556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:54.765486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.765790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.766067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.766347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:54.766857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:54.767486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.767940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.768358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.768467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:54.783269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:54.784333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:51:54.785170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:54.790583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 432/863] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jun 3 08:51:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:54.791716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:54.794616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:54.799020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:54.846030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:54.848698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:54.850999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:54.850999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:54.850999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:54.850999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:54.850999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 432/864] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:54.858534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:54.922484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1ffa0-f6cf-4d11-9ced-33fafb29d84a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:54.963234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:54.976979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:54.979830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:54.980418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:54.980906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:54.981826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:54.982334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:54.984412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:54.994814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 433/865] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:51:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:55.002021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:55.024914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9b3c1-a519-40e4-9399-8a14266d7f18 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:55.028839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:55.076831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:55.077676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.078190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.078492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.079279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:55.079598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:55.081754 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:55.105144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 433/866] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:55.107195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:55.158852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a92a-5a92-44de-9ec1-12a1861abb23 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:55.199511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:55.199974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.200328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.200763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.201546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:55.201863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:55.203412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:55.215796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 434/867] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:51:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:55.249762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71d15-d39f-4f04-8575-efb268a2e892 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:55.300140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:55.302053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.302549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.303048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.316224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:55.318832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:55.339772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:55.340721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:55.341608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 434/868] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:55.348973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:55.418101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:55.476711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a77c-4ed4-4995-b092-9c2ccb69c671 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:55.514614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:55.515296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.515577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.515927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.516732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:55.517087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:55.518570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3752d13-135a-4d88-a754-7e901b7bac60 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:55.535690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 435/869] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:55.547133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:55.598344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:55.703908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598dd-6cbd-4820-bd81-1c98116681cd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:55.742632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:55.743354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.743636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.744012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.745116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=d8b00fb60e5e4548a5371831e56ad76b) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:55.745611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:55.747283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c678b-17b9-4e1e-b021-d276908d7ffe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:55.754038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 435/870] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:55 2022] GET /identity/v3/role_assignments?user.id=d8b00fb60e5e4548a5371831e56ad76b&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:55.783696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c05bbe-a4f1-41ed-8a28-73ec07f37c73 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.784279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c05bbe-a4f1-41ed-8a28-73ec07f37c73 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.784279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c05bbe-a4f1-41ed-8a28-73ec07f37c73 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.785885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 436/871] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:55.792225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a95de-1b7f-49e6-9f96-aceea3b5ddf6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:55.792559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a95de-1b7f-49e6-9f96-aceea3b5ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:55.792830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a95de-1b7f-49e6-9f96-aceea3b5ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:55.813974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-774a95de-1b7f-49e6-9f96-aceea3b5ddf6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:55.815196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-774a95de-1b7f-49e6-9f96-aceea3b5ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:55.894031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 436/872] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:55.917386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c05bbe-a4f1-41ed-8a28-73ec07f37c73 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:56.044336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c05bbe-a4f1-41ed-8a28-73ec07f37c73 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:56.060233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:56.083620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8917d-7c31-4237-90aa-31f8e42fdfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:56.084331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8917d-7c31-4237-90aa-31f8e42fdfd0 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:56.084609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8917d-7c31-4237-90aa-31f8e42fdfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:56.084874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8917d-7c31-4237-90aa-31f8e42fdfd0 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:56.085595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8917d-7c31-4237-90aa-31f8e42fdfd0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:56.087020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8917d-7c31-4237-90aa-31f8e42fdfd0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:56.104418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 437/873] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:51:55 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:51:56.632249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a6a64-8143-43de-b33a-f2ac8d2ae3db None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:56.632531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a6a64-8143-43de-b33a-f2ac8d2ae3db None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:56.633647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a6a64-8143-43de-b33a-f2ac8d2ae3db None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:56.635534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 437/874] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:56.640902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:56.641485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:56.642016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:56.660730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:56.662265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:56.744723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 438/875] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:51:56.769080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a6a64-8143-43de-b33a-f2ac8d2ae3db None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:56.790960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:56.879552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a6a64-8143-43de-b33a-f2ac8d2ae3db None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:56.915686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:56.916458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:56.916741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:56.917016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:56.927924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:51:56.936684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:56.937661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:56.938525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 438/876] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 08:51:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:56.944095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.058161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:57.063951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a10e1-03a5-4d24-a91a-5d8fa537b3ce None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:57.102457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:57.103379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.103843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.104296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.105190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:57.105656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:57.107198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:57.116450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 439/877] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:51:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:57.125073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.211992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:57.235152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9e91-4fcd-49d6-8c9c-a9113e74f60b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:57.271195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:57.272026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.272314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.272587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.284069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:57.285559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:57.305062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:57.306603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:57.307633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:57.307633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:57.307633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:57.307633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:57.307633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 439/878] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:57.313335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.423224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cda8c-88d8-4be6-bdab-e414e1c73e03 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:57.458148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:57.458834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.459116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.459392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.460144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:57.460451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:57.461876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb456d6a-6228-40ce-b648-2e5dc5658536 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:57.474925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 440/879] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:57.480861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.590416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218030d2-aa5d-4f1b-9d2e-4bc9e93aaef7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:57.627279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:57.630801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:57.631647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.631967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.632250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.641184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:57.642682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:57.647994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd65b34-6891-4d3e-9e78-4a4ee2c7af29 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.648288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd65b34-6891-4d3e-9e78-4a4ee2c7af29 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.648568 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd65b34-6891-4d3e-9e78-4a4ee2c7af29 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.654544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 441/880] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:57.656289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.656811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.657286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:51:57.658519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:57.659443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:57.660560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 440/881] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:51:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:57.665303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.689793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:57.692233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:57.714985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:57.783945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 442/882] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:57.800826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.806430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b87a5a-5612-40df-ab55-a03cfc8bccbb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:57.847580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:57.848294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.848576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.848852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.849695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:57.850004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:57.851443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:57.870942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 441/883] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 08:51:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:57.876496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:57.937362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c564772-1f46-4dc3-9c55-d9920fb8f046 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:57.939682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:57.983054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87664797-a7b4-4181-8ff2-384aa702b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:57.988464 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664797-a7b4-4181-8ff2-384aa702b7d9 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:57.989281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664797-a7b4-4181-8ff2-384aa702b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:57.990420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664797-a7b4-4181-8ff2-384aa702b7d9 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:57.991515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87664797-a7b4-4181-8ff2-384aa702b7d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:57.994324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87664797-a7b4-4181-8ff2-384aa702b7d9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.005922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad2eae-68fe-45ec-9bd9-af52313ebcf9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:58.015412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 443/884] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:51:57 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:51:58.061290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:58.062051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.062392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.062669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.143162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:58.144787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.199230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:58.241868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cc7d-5bca-46f7-9dc0-6723c993bbe4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.242181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cc7d-5bca-46f7-9dc0-6723c993bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.242476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cc7d-5bca-46f7-9dc0-6723c993bbe4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.244696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 444/885] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:51:58.250547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.250742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.250963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.261201 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 442/886] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:51:57 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:51:58.267456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.271211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:58.272307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:58.281350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:58.369290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 445/887] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:58.391416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.406991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bd5ec-1772-47cd-8092-dbfaac07368f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:58.452664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:58.453711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.454060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.454637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.468794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:58.470261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.473763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:51:58.495050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:58.496117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:58.497025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:51:58.497025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:51:58.497025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:51:58.497025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:58.499857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 443/888] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:58.502873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.504313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5754e11-26bd-4902-9bb3-e7fcebc666cd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:58.557643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:58.558757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.559041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.559313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.560336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:58.562142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:58.579323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:58.580895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:51:58.581954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 446/889] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:51:58.587018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.599545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:58.625653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c374a1-a6be-4946-bc02-d4136803ca17 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:58.665021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:58.665686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.666033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.666318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.667038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:58.667346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:58.668811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84142f7-268d-4526-a5ad-7c8146a4e274 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.685173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 444/890] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:58.686822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506eb4a-2c4c-4daf-b762-5d2b8a8190f9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.687313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506eb4a-2c4c-4daf-b762-5d2b8a8190f9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.687804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506eb4a-2c4c-4daf-b762-5d2b8a8190f9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.689833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 445/891] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:51:58.690853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506eb4a-2c4c-4daf-b762-5d2b8a8190f9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.713692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d7ead-0530-4ed0-9697-a5c2fa660f2d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:58.753710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:58.757521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:58.758231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.758519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.758792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.759664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:58.760007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:58.761391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d66b2a-3531-4a3f-b4fc-e3b469125f3a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.771020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 447/892] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:58.771020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.771020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.771020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.789155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:51:58.790913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:51:58.804682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506eb4a-2c4c-4daf-b762-5d2b8a8190f9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:58.847340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:58.848551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:58.849015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:58.849453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:58.857058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:58.858821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:58.861108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:58.862169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 448/893] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:51:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:51:58.862986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:51:58.881657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:58.882763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:51:58.884559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:58.889886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 446/894] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:58.890615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:58.986096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9c2b1-20ab-4be1-bb01-4f5c0be3443d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.000253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6d90-6e96-46f8-8233-1342422bcbe8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.017954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:59.024589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.025434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.025716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.026309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.027021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:59.027333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.028749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.033274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 449/895] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:59.034048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:59.047918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.049115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.049645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.050102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.051233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.053025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:51:59.066840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:51:59.068214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:51:59.069076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:51:59.072601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 447/896] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:51:59.080864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:59.130450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:59.182007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbca8b3-de4b-41d6-8bbb-1e6bb6813ac5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.212759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a028-32cc-49b8-ab84-57f6120dda35 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.225856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.226551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.226875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.227156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.228042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:59.228304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.229790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.248044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 450/897] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:59.249774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:59.258193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.259701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.260215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.260661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.261535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:59.262041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.263609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.269884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 448/898] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:59.279780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:59.345602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:59.395680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5995f6e-d528-4109-8dd2-805c7e4abf91 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.410753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82762f-223b-404a-9c12-24ab336cff94 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.427825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:59.445317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.446922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.447413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.447951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.448932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] RBAC: Adding query filter params (role.id=25391cb59b2649cd894181c320f6a35e, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=8294ae6c597b4a198312fb562357bf72) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:59.449519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.450124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.450897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.451282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.451658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.451859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.452642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:59.453050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.454577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.467981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 449/900] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:51:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:59.468202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 451/900] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:51:59 2022] GET /identity/v3/role_assignments?user.id=8294ae6c597b4a198312fb562357bf72&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=25391cb59b2649cd894181c320f6a35e => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:51:59.468294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:59.590269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfdbb2-1cd0-4a66-92a6-f4a53fbd42d6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.601417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:51:59.631932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.633004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.633533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.634012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.635066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] RBAC: Adding query filter params (interface=public, service_id=32ebbd7e737e481ea6fcb7fc556e9ae9, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:51:59.635601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.637281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc494-6969-499a-a09e-d268dfcd2f08 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.644283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 450/901] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:51:59 2022] GET /identity/v3/endpoints?service_id=32ebbd7e737e481ea6fcb7fc556e9ae9&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:51:59.649716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:51:59.771100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3866f-b391-4d32-9849-14ca5684377b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:51:59.807542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9a248-7e25-48b7-931f-012c11cd6a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:51:59.808247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a248-7e25-48b7-931f-012c11cd6a9a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:51:59.808526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a248-7e25-48b7-931f-012c11cd6a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:51:59.808798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a248-7e25-48b7-931f-012c11cd6a9a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:51:59.809474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a248-7e25-48b7-931f-012c11cd6a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:51:59.810837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a248-7e25-48b7-931f-012c11cd6a9a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:51:59.817574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 452/902] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:51:59 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 08:52:00.379463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e878-eb66-421c-a9ab-279f9adaf7cb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:00.380020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e878-eb66-421c-a9ab-279f9adaf7cb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:00.380099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e878-eb66-421c-a9ab-279f9adaf7cb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:00.381671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 451/903] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:00.387119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:00.387524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:00.387715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:00.404886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:00.406089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:00.456740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:00.483886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 453/904] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:00.501957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e878-eb66-421c-a9ab-279f9adaf7cb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:00.610565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e878-eb66-421c-a9ab-279f9adaf7cb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:00.647203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:00.648522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:00.649552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:00.650025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:00.650899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:00.652646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:00.667009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:00.668025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:52:00.668889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:00.671936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 452/905] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jun 3 08:52:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:00.679822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:00.785841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6836d-69ee-42a4-91c0-e358a4951c12 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:00.823335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:00.824039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:00.824327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:00.824600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:00.825300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:00.825606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:00.826986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:00.832425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 454/906] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:00.837983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:00.875550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:00.948400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312d07-5ca8-4a09-89fd-b7b15a3dda23 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:00.991420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:00.992904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:00.993425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:00.993898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:00.994832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:00.995343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:00.996988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:01.002946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 453/907] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:01.009414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:01.060932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:01.120751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29636-2c83-4fc3-bdbd-70e093e6809a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:01.158238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd395550-7238-4784-9761-58864b7a577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:01.159276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395550-7238-4784-9761-58864b7a577f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.159787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395550-7238-4784-9761-58864b7a577f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.160264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd395550-7238-4784-9761-58864b7a577f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.161266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd395550-7238-4784-9761-58864b7a577f None admin] RBAC: Adding query filter params (interface=public, service_id=90ba97c11a104c4481197bd08c435cbf, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:01.161779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd395550-7238-4784-9761-58864b7a577f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:01.163432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd395550-7238-4784-9761-58864b7a577f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:01.174335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 455/908] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:52:01 2022] GET /identity/v3/endpoints?service_id=90ba97c11a104c4481197bd08c435cbf&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:01.176827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:01.283229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:01.285968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b316-2798-437f-8fbf-6e4659cb2020 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:01.323078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035190-dbc4-4574-9a20-7d362493f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:01.323775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035190-dbc4-4574-9a20-7d362493f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.324068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035190-dbc4-4574-9a20-7d362493f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.324359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035190-dbc4-4574-9a20-7d362493f3c0 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.325033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035190-dbc4-4574-9a20-7d362493f3c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:01.326414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035190-dbc4-4574-9a20-7d362493f3c0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:01.332829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 454/909] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:52:01 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 08:52:01.483480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8122e0-2352-4f4e-b46c-338747ec1d6f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.484070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8122e0-2352-4f4e-b46c-338747ec1d6f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.484319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8122e0-2352-4f4e-b46c-338747ec1d6f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.486215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 456/910] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:01.492246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd998-89f8-46a5-b177-7870b2f5dfdd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.492807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd998-89f8-46a5-b177-7870b2f5dfdd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.493239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd998-89f8-46a5-b177-7870b2f5dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.512691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-802cd998-89f8-46a5-b177-7870b2f5dfdd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:01.513953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-802cd998-89f8-46a5-b177-7870b2f5dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:01.591508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 455/911] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:01.614826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8122e0-2352-4f4e-b46c-338747ec1d6f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:01.727740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8122e0-2352-4f4e-b46c-338747ec1d6f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:01.740483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:01.764740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e8bc-c689-40e7-a906-ed09150392b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:01.765472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e8bc-c689-40e7-a906-ed09150392b3 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.765756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e8bc-c689-40e7-a906-ed09150392b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.766082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e8bc-c689-40e7-a906-ed09150392b3 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.766805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e8bc-c689-40e7-a906-ed09150392b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:01.768224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e8bc-c689-40e7-a906-ed09150392b3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:01.784989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 457/912] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:52:01 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:01.849808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16b36-9802-42b6-a2e4-0ef37afeb148 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.849993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16b36-9802-42b6-a2e4-0ef37afeb148 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.850270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac16b36-9802-42b6-a2e4-0ef37afeb148 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.851653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 456/913] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:01.857652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ec9d5-67fd-4ea3-b472-46a378fc0c45 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:01.857965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ec9d5-67fd-4ea3-b472-46a378fc0c45 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:01.858440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ec9d5-67fd-4ea3-b472-46a378fc0c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:01.880817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4b0ec9d5-67fd-4ea3-b472-46a378fc0c45 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:01.882034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4b0ec9d5-67fd-4ea3-b472-46a378fc0c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:01.973115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 458/914] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:02.001642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16b36-9802-42b6-a2e4-0ef37afeb148 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.112051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.120254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac16b36-9802-42b6-a2e4-0ef37afeb148 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.157261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.158461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.158974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.159448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.162713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4deec-7214-484b-af51-f86f9df95c0f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.162948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4deec-7214-484b-af51-f86f9df95c0f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.163214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4deec-7214-484b-af51-f86f9df95c0f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.168275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 459/915] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:02.170426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.170711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.170985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.172966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:02.182385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:02.183340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:02.184235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:02.186936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 457/916] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:02.191710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:02.191710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:02.192942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.271454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 460/917] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:02.290425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.299478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aa9dd-f7ad-4cff-8d2c-3adadae636a5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.319905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.337044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.338088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.338577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.339057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.340072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:02.340386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.341781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:02.350540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 458/918] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:02.356274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.376199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.409898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bde06c-3a22-4614-a4fe-603a5b9ac6c7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.453156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.454349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.455039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.455493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.456560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.457960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:02.467248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e298eb-36a3-42fb-8b2a-a483cb1e3bd9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:02.474093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:02.475095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 08:52:02.475971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:02.477677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 461/919] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:02.483021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.519031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.521627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.521905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.522185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.545621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.547947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:02.572816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:02.573961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:02.574888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:02.574888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:02.574888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:02.574888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:02.580580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 459/920] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:02.582079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.610996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.627648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f7fc-4558-43e8-a286-7e5f1f0d3648 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.662692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.673040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.673994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.674454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.675305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.676508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:02.676991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.679167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:02.692116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 462/921] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:02.693657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.710542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724024e-053c-4f44-a7b7-18e432e5e91c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.754152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.754987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.755590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.755983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.756782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:02.757404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.759406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:02.779919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 460/922] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:02.781936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.824977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91604946-d2c6-4a62-b45e-4acc59f5909a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.865941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.866604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.867974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.868670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.869544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:02.869991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.871661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:02.883939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 463/923] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:02.885026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:02.909577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.918555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dc0a-e73a-4fc6-aa7d-c63c1c7eb4de None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:02.955438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:02.973273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:02.974253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:02.974602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:02.974943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:02.993049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:02.996004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:03.017357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f1704-7b9e-44cf-8bad-bb1ca05d9265 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:52:03.018105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:03.019012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:52:03.019989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:03.024267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 461/924] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:52:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:03.025834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:03.064805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:03.065910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.066401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.066881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.067848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:03.069478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:03.092734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 464/925] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:52:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:03.156796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baceeba-09c0-48b2-812a-54247458f86c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.207242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:03.208488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.209023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.209526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.210604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:03.211654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:03.213430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:03.237741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 462/926] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 08:52:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:03.243948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:03.341857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:03.372998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71c32-8041-4378-b4d0-a6f19a9d4375 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.410646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:03.411377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.411661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.411985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.423439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:03.424956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:03.443636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:03.444597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:03.445996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:03.445996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:03.445996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:03.445996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:03.445996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 465/927] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:03.450982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:03.506124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:03.572193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f99de-cec9-4505-8dab-04379d5eb7e9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.614017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:03.614693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.614977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.615255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.616020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:03.616331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:03.617777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b986871-7c3b-48fc-aefb-4357ee44e9c5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:03.630385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 463/928] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:03.636946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:03.681869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edec86-c92d-4c03-81ec-d215ebec8026 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.682066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edec86-c92d-4c03-81ec-d215ebec8026 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.682345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edec86-c92d-4c03-81ec-d215ebec8026 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.684025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 464/929] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:03.688979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.689356 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.689694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.708968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:03.710173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:03.749021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40928157-cbb0-4c0a-8d61-1f9dde4e7a36 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.776041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:03.786528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:03.793976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 465/930] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:03.794125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.794125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.794125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.799815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:03.801623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:03.814972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:52:03.819867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:03.821347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:03.822230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:03.825237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 466/931] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:03.830375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:03.853932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:03.937487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88ffce-228c-4b0a-b928-59ff189181ea None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.976348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02f8d7-2198-4a5a-82ff-62f471bb8653 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:03.990861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:03.993148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:03.993742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:03.994221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:03.995334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:03.997793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:04.016223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:04.017343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 08:52:04.018184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:04.020216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.021591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.021591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.021591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.025866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:04.025866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.025866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.026218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 466/932] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jun 3 08:52:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:04.027610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.041536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 467/933] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:04.049258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.096813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:04.133454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:04.140966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1b825-1847-4926-8671-e43a048d5063 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.168806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1eea-8776-4ff2-852c-3340d54e2f95 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.187681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.188708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.188991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.189264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.189969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:04.190271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.192193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.199909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 467/934] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:04.205915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.207517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94f284-981e-4a08-89a3-0ec106fa2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.208661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f284-981e-4a08-89a3-0ec106fa2e0c None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.209169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f284-981e-4a08-89a3-0ec106fa2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.209644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94f284-981e-4a08-89a3-0ec106fa2e0c None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/8294ae6c597b4a198312fb562357bf72/roles/25391cb59b2649cd894181c320f6a35e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.212341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94f284-981e-4a08-89a3-0ec106fa2e0c None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=8294ae6c597b4a198312fb562357bf72, role_id=25391cb59b2649cd894181c320f6a35e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.214058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94f284-981e-4a08-89a3-0ec106fa2e0c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.238829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 468/935] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:52:04 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/8294ae6c597b4a198312fb562357bf72/roles/25391cb59b2649cd894181c320f6a35e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:52:04.266626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1b79-a313-4bb6-b492-484483bc82f3 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.266940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1b79-a313-4bb6-b492-484483bc82f3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.267270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1b79-a313-4bb6-b492-484483bc82f3 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.269033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 469/936] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:04.274900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.275222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.275455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.297084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:04.299288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:04.345500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca38e-d9fb-42e8-9125-36af59165ad3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.392828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 470/937] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:04.397205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.397957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.398244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.399032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.399796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:04.400125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.401544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.412109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 468/938] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:04.413510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.417239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.454213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:04.462048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:04.548965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce47916-53c6-45a6-af78-f82581c520ea None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.558500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb462c85-a98f-4472-9818-e57c19c3cb6c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.588100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.588763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.588998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.589270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.590021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.591496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.607157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.609008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.609579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.610044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.611195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.613004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.613839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 471/939] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:52:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:04.627514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:04.628616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:04.629444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:04.632787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 469/940] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:04.639529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.764255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:04.785357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539e44-c4c8-4b3d-9ea6-537993096e1b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.825083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.825813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.826109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.826384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.827089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:04.827401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:04.828819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:04.835006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 472/941] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:04.841237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:04.939054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:04.953477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38064c-f33b-4bb7-a432-194843781b35 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:04.997087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:04.997760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:04.998043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:04.998316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:04.999033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:04.999344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:05.000781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:05.006788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 470/942] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:05.012955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:05.118877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594cea-3976-400d-bd0a-66df98ae7e6c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:05.155082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:05.156204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:05.156708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:05.157194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:05.158212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] RBAC: Adding query filter params (interface=public, service_id=2686741449ee497d9f060d790db34f69, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:05.158741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:05.160403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547da83-529c-4f32-b945-5fc444782489 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:05.167797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 473/943] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:52:05 2022] GET /identity/v3/endpoints?service_id=2686741449ee497d9f060d790db34f69&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:05.173899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:05.288475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf89fb-0431-4540-a707-132c3fe9fa8b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:05.325339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaf5d9-1b09-4cfe-a32f-a5d1b8dd2dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:05.326008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaf5d9-1b09-4cfe-a32f-a5d1b8dd2dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:05.326290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaf5d9-1b09-4cfe-a32f-a5d1b8dd2dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:05.326564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaf5d9-1b09-4cfe-a32f-a5d1b8dd2dd4 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:05.327246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaf5d9-1b09-4cfe-a32f-a5d1b8dd2dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:05.328653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaf5d9-1b09-4cfe-a32f-a5d1b8dd2dd4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:05.335231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 471/944] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:52:05 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 08:52:05.512836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84212c-3e54-453a-8ded-22bebf24293e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:05.513205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84212c-3e54-453a-8ded-22bebf24293e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:05.513329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84212c-3e54-453a-8ded-22bebf24293e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:05.514958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 474/945] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:05.521073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:05.521375 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:05.521633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:05.544838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:05.546197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:05.562860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:05.633723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 472/946] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:05.657449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84212c-3e54-453a-8ded-22bebf24293e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:05.676371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:05.763028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84212c-3e54-453a-8ded-22bebf24293e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:05.797887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:05.798557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:05.798836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:05.799108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:05.799849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:05.801601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:05.803004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING keystone.server.flask.common [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 08:52:05.822562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.sql.core [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 08:52:05.822562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 08:52:05.822562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [parameters: {'id': 'e22eceb811274cdbaa28083cb6fc43c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 08:52:05.822562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80221) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e22eceb811274cdbaa28083cb6fc43c1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e22eceb811274cdbaa28083cb6fc43c1. Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 08:52:05.830870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 03 08:52:05.831675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application yield resource Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise self.value Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application session.commit() Jun 03 08:52:05.832670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.flush() Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application compat.raise_( Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 08:52:05.833576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 08:52:05.834490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 08:52:05.835553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [parameters: {'id': 'e22eceb811274cdbaa28083cb6fc43c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:05.839189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:05.841295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e22eceb811274cdbaa28083cb6fc43c1. Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:05.844095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 475/947] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Jun 3 08:52:05 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:05.844757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:05.951800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29740-1d05-4a0a-90f7-6ae77556467d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:05.993098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:05.994219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:05.994685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:05.995140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:06.003075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:06.004851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ae0bb569-5585-4b3a-8295-45cab412a525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:52:06.020423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:06.021327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:06.022303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:06.024772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 473/948] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:06.030902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:06.106835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:06.140204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca33e-1c33-400f-b445-620b64a59e3d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:06.175162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:06.176181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:06.176517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:06.176804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:06.177570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:06.177882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:06.179556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e966a-5c0a-4db1-bd17-94d498afd578 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:06.202366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 476/949] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:06.614471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad74895-18ff-42ad-8073-3db3d18ec0b6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:06.614809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad74895-18ff-42ad-8073-3db3d18ec0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:06.615021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad74895-18ff-42ad-8073-3db3d18ec0b6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:06.616447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 474/950] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:06.622764 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:06.623059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:06.623347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:06.641322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:06.642853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:06.715392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 477/951] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:06.739659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad74895-18ff-42ad-8073-3db3d18ec0b6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:06.750425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:06.856309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad74895-18ff-42ad-8073-3db3d18ec0b6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:06.892359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f516ea4-965c-4de9-97a4-25d278416169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:06.893442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516ea4-965c-4de9-97a4-25d278416169 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:06.893940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516ea4-965c-4de9-97a4-25d278416169 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:06.894363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516ea4-965c-4de9-97a4-25d278416169 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:06.906455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f516ea4-965c-4de9-97a4-25d278416169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9f516ea4-965c-4de9-97a4-25d278416169 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:06.915490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:06.916693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:06.917762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:06.920141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 475/952] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 08:52:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:06.926970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.020563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.036424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c9f6c-8d14-4749-828a-62250182601e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.073271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.073957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.074244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.074585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.075346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:07.075657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.077146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.087001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 478/953] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:52:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:07.088525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fc29d-7fbb-4196-8885-0fc92af5c224 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.088815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fc29d-7fbb-4196-8885-0fc92af5c224 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.089088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fc29d-7fbb-4196-8885-0fc92af5c224 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.090563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 476/954] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:07.095552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.096179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.096678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.097159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.117421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:07.119081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:07.197708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.211847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 477/955] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:07.222796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95256da7-40a7-4872-8275-b43dfe58dce1 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.234792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.249935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.262207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.263252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.263686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.264081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.277575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.279177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:07.298296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:07.299436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:07.300634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:07.300634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:07.300634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:07.300634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:07.301257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 479/956] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:07.306730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.353944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ead9d2-ef98-475f-82f0-12b1bbf56f12 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.390878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.392196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.392718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.393192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.394133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.395829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:07.409792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:07.410891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:07.411834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:07.419585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 478/957] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:07.420724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.444889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a909b-9842-4fa8-b790-f2ad66caed9d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.499151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.503142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.504096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.504379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.504655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.505941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:07.506281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.508526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.525676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 480/958] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:07.530868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.547794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c023-b881-4f73-9ea3-749cd35f5f69 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.577987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.586220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.587102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.587653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.588154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.589082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:07.589638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.591304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.601838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 479/959] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:07.603018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.667417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac03cb-b338-490c-8d6a-a47e8e251334 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.713844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.714676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.714964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.715241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.725436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.727114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.741006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38158f9-8b29-42ea-baf9-7f6166311f99 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:52:07.748022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:07.749098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:07.750114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 481/960] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:07.754719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.773518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.787526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.788799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.789735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.790131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.791031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:07.791398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.792976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68fc65-efc0-44e2-81ff-ce385166b9e3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.803889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 480/961] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:07.824656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ad2e-7948-4e60-a4bc-4c7ed91835e0 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.824956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ad2e-7948-4e60-a4bc-4c7ed91835e0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.825225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ad2e-7948-4e60-a4bc-4c7ed91835e0 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.826972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 481/962] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:07.832753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.833025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.833307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.850897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:07.852729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:07.875409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:07.884330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905fb25-5144-48b7-95d7-a8fa24372382 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:07.928768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:07.929762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:07.930196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:07.930619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:07.931651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:07.932143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:07.933793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:07.958892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 482/964] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:07.959143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 482/964] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:07.960999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:07.981396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.108248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdef52-b1a1-4584-9751-36f79bd40ce9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.110212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e156-9906-4054-aac0-e668857e2918 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.128344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:08.147927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.149303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.149686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.150338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.164182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.165522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.166740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.167174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.168505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.170621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:08.188838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:08.190135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:08.191189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:08.194762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 483/965] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:08.201318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.225699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:08.254097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.256012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.318391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77535-87f2-47f3-9ba7-da78da139ed6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.355025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.355731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.356045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.356325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.357032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:08.357344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.358835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.369405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 484/966] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:08.370312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.372100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 483/967] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 08:52:08.377482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.402842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:08.463575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:08.486219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a467f69-c8c8-4fb3-93ce-0022348c9a72 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.512464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d46556-da6b-452e-9fae-02fd9f997558 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.522262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.522942 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.523228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.523636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.524619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:08.524935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.526433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.531996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 485/968] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:08.537871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.557772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.559328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.560102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.560927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.577481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.579951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-392e23c7-712b-494e-9f62-b1ada53b5027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:08.598865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:08.600033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:08.601122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:08.601122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:08.601122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:08.601122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:08.608042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 484/969] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:08.608042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409998-1c4e-496b-9a58-09eb04a2e457 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.608042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409998-1c4e-496b-9a58-09eb04a2e457 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.608042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409998-1c4e-496b-9a58-09eb04a2e457 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.608042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 485/970] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:08.609490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409998-1c4e-496b-9a58-09eb04a2e457 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.655046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb57fa-3793-43f3-94d2-1c867756250d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.690781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:08.692260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd94c-8557-4423-90ea-82d65e855c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.693123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd94c-8557-4423-90ea-82d65e855c5a None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.693455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd94c-8557-4423-90ea-82d65e855c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.693768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd94c-8557-4423-90ea-82d65e855c5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.694472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd94c-8557-4423-90ea-82d65e855c5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.696047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd94c-8557-4423-90ea-82d65e855c5a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.722122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 486/971] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:52:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:52:08.722122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.722122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.722122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.722505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:08.739066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:08.740655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:08.749750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409998-1c4e-496b-9a58-09eb04a2e457 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:08.797562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:08.798614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:08.799155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:08.799648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:08.800892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:08.801506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:08.803001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:08.818126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 486/972] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:08.829164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.830965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 487/973] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:08.860481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:08.974170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515793e-9512-4ce7-bfa9-28a23def74a7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:09.004786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8ca7-8cf2-4fa3-a8fe-5ac14842de8f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:09.010396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:09.021969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:09.023209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:09.024133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:09.024857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:09.038713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:09.041823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:09.045461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:09.051561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:09.052399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:09.052788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:09.053167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:09.054004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:09.055606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:52:09.067598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:09.068751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:09.069661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 487/974] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:09.071895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.sql.core [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 08:52:09.071895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 08:52:09.071895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [parameters: {'user_id': '5ff327f32e61407b978dc6ed3a9e72b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 08:52:09.071895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80221) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 08:52:09.080226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 08:52:09.081385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application yield resource Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise self.value Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application session.commit() Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 08:52:09.082582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.flush() Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application compat.raise_( Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 08:52:09.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 08:52:09.084916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 08:52:09.086605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [parameters: {'user_id': '5ff327f32e61407b978dc6ed3a9e72b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:09.087693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 03 08:52:09.088832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 03 08:52:09.089940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 03 08:52:09.089940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 03 08:52:09.089940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 08:52:09.089940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 08:52:09.089940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 08:52:09.089940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:09.090350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:09.090910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 488/975] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 08:52:08 2022] POST /identity/v3/users => generated 160 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:09.099838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:09.200582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427da476-87eb-4897-bbf4-f3e9616b7fbb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:09.208478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b9c0-812f-4918-8153-24fbffa8a2ac None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:09.239527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:09.240225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:09.240601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:09.240890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:09.241894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:09.242246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:09.243510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:09.243835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:09.244348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:09.244629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:09.244901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:09.253181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:09.254847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:09.257475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 488/976] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:09.265109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:52:09.270175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:09.272291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:09.276214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 489/977] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:09.277564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:09.335629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:09.341786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:09.387524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0741f-2f65-49df-a767-d5832385fb35 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:09.400441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf341dc-8688-441b-b920-561b5ef19ef7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:09.434489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:09.435165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:09.435454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:09.435725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:09.436776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:09.437084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:09.438627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d172ba8-2d20-4866-af67-43f7cd936f30 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:09.439772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:09.440743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:09.441208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:09.441681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:09.442691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] RBAC: Adding query filter params (role.id=25391cb59b2649cd894181c320f6a35e, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=8294ae6c597b4a198312fb562357bf72) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:09.443194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:09.444863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb677ad-9803-4fc3-a176-789df67f7e7e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:09.452810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 489/978] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:09 2022] GET /identity/v3/role_assignments?user.id=8294ae6c597b4a198312fb562357bf72&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=25391cb59b2649cd894181c320f6a35e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:09.485279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 490/979] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 08:52:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:10.192988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83e81e-0c3f-4dab-8eaa-bf206d214e8e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:10.193525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83e81e-0c3f-4dab-8eaa-bf206d214e8e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:10.193525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83e81e-0c3f-4dab-8eaa-bf206d214e8e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:10.195130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 490/980] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:10.200325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daf7bf-7142-434c-973f-85325d2e68ca None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:10.200744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daf7bf-7142-434c-973f-85325d2e68ca None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:10.200909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daf7bf-7142-434c-973f-85325d2e68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:10.218038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-37daf7bf-7142-434c-973f-85325d2e68ca None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:10.219545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-37daf7bf-7142-434c-973f-85325d2e68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:10.289759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 491/981] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:10.312972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83e81e-0c3f-4dab-8eaa-bf206d214e8e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:10.418020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83e81e-0c3f-4dab-8eaa-bf206d214e8e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:10.428684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:10.454858 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcdb59-2b59-4294-88de-dc8d7bc4481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:10.455528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcdb59-2b59-4294-88de-dc8d7bc4481c None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:10.455844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcdb59-2b59-4294-88de-dc8d7bc4481c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:10.456118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcdb59-2b59-4294-88de-dc8d7bc4481c None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:10.456838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcdb59-2b59-4294-88de-dc8d7bc4481c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:10.458220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcdb59-2b59-4294-88de-dc8d7bc4481c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:10.488059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 491/982] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:52:10 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:11.091727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bffc8-fb76-4bc3-8ca8-8c77f62a4655 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.092084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bffc8-fb76-4bc3-8ca8-8c77f62a4655 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.092322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bffc8-fb76-4bc3-8ca8-8c77f62a4655 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.093865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 492/983] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:11.099009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.099307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.099590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.116695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:11.117934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:11.203916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 492/984] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:11.225005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bffc8-fb76-4bc3-8ca8-8c77f62a4655 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:11.272689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:11.335773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bffc8-fb76-4bc3-8ca8-8c77f62a4655 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:11.372067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:11.372884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.373165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.373439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.374086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:11.375480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:11.388080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:11.389080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:11.389992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:11.391727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 493/985] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:11.395377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:11.497592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:11.505135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94392d-9140-4a3d-99bf-74eab56c4ec0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:11.540164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:11.540961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.541359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.541734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.542533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:11.542936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:11.544417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:11.554227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 493/986] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:11.556074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:11.665570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d354d2-7890-44ac-8368-d0457d50717b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:11.673275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:11.706950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:11.707625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.707974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.708204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.708917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:11.709227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:11.710599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ae3bd-cb5d-46e0-b5e8-b2860488feec None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:11.720576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 494/987] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:11.722312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:11.805461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c856e4e-af01-4cc4-a459-ee1d2f7c4ec0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.805749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c856e4e-af01-4cc4-a459-ee1d2f7c4ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.806100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c856e4e-af01-4cc4-a459-ee1d2f7c4ec0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.808690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 495/988] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:11.814554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.814845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.815118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.833091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:11.834376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:11.836517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e733cf-0d51-4660-9b56-5b3498d99c79 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:11.873143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:11.873963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:11.874339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:11.874713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:11.875607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] RBAC: Adding query filter params (interface=admin, service_id=2686741449ee497d9f060d790db34f69, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:11.876053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:11.877642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:11.887916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 494/989] 10.222.0.61 () {56 vars in 1249 bytes} [Fri Jun 3 08:52:11 2022] GET /identity/v3/endpoints?service_id=2686741449ee497d9f060d790db34f69&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:11.889981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:11.906274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 496/990] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:11.919158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:11.929029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:12.009917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d259f-e4b7-490f-b99a-8178bda90e46 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:12.040372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:12.044293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449228f-fb0d-40ac-9fd3-771f3215e07f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:12.048732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:12.049402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:12.049686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:12.049962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:12.050902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:12.052326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:12.071882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 495/991] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:52:11 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 08:52:12.103620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:12.105135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:12.105135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:12.105135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:12.105776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:12.108446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:12.128078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:12.129428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:12.130446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 497/992] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jun 3 08:52:11 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:12.135711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:12.238651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:12.253228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc3a8b-a293-4cf9-a71c-6b90d484a67a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:12.293447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:12.294131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:12.294415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:12.294687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:12.295397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] RBAC: Adding query filter params (name=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:12.295706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:12.297191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f90ff-2b05-452a-9da9-003b844e220a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:12.303575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 496/993] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:12.308893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:12.414594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d62626-91c3-4a96-98dd-87435bf690c6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:12.449324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:12.450029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:12.450311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:12.450584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:12.451309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] RBAC: Adding query filter params (type=image) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:12.451619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:12.453110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8b4da-96a3-4884-acef-06231a82d0be None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:12.463797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 498/994] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:12.793650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7598ab-8974-4e93-b25d-1840aa71af12 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:12.794094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7598ab-8974-4e93-b25d-1840aa71af12 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:12.794719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7598ab-8974-4e93-b25d-1840aa71af12 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:12.797498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 497/995] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:12.803182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:12.803476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:12.803774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:12.821721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:12.822917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:12.847235 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:12.901958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 499/996] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:12.924363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7598ab-8974-4e93-b25d-1840aa71af12 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:13.058815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7598ab-8974-4e93-b25d-1840aa71af12 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:13.111436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:13.112732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:13.113199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:13.113668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:13.114797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:13.117700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:13.138589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:13.139876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:13.146189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 498/997] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:13.146995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:13.252839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8078ebd-18ea-493d-a922-18fa9c4d6333 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:13.288264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:13.289476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:13.289810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:13.290094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:13.290803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:13.291114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:13.292525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:13.300210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 500/998] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:13.306890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:13.327137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:13.415075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1adb39-49ab-41f1-995d-69101d7a933c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:13.449663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:13.450323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:13.450608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:13.450884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:13.451585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:13.451924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:13.453295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:13.458334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 499/999] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:13.464472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:13.490031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:13.578386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83f6ec-1145-4395-8048-1b4e4a2e1d1f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:13.615049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:13.615711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:13.616024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:13.616304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:13.617144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] RBAC: Adding query filter params (interface=public, service_id=e9404751838640d48f4844cf12eda39c, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:13.617459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:13.618828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3686-f3c9-4ba2-902c-e5993024ad43 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:13.624293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 501/1000] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:52:13 2022] GET /identity/v3/endpoints?service_id=e9404751838640d48f4844cf12eda39c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:13.629445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:13.714917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:13.735729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f2d1-bb59-496c-81a0-f82e4925152c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:13.769520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e053f-5d29-4dcb-9e5e-081b975a082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:13.770194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e053f-5d29-4dcb-9e5e-081b975a082b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:13.770481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e053f-5d29-4dcb-9e5e-081b975a082b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:13.770759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e053f-5d29-4dcb-9e5e-081b975a082b None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:13.771438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e053f-5d29-4dcb-9e5e-081b975a082b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:13.772849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e053f-5d29-4dcb-9e5e-081b975a082b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:13.787832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 500/1001] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:52:13 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 08:52:14.394990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243032e7-5f54-4ab9-8a61-6ff24450ca06 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:14.395395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243032e7-5f54-4ab9-8a61-6ff24450ca06 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:14.395601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243032e7-5f54-4ab9-8a61-6ff24450ca06 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:14.397172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 502/1002] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:14.402968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:14.403517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:14.403517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:14.421470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:14.422715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:14.493174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 501/1003] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:14.517125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243032e7-5f54-4ab9-8a61-6ff24450ca06 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:14.606747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:14.626476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243032e7-5f54-4ab9-8a61-6ff24450ca06 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:14.665242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000902-1703-4585-b76e-a5f18098117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:14.665970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000902-1703-4585-b76e-a5f18098117a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:14.666250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000902-1703-4585-b76e-a5f18098117a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:14.666527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000902-1703-4585-b76e-a5f18098117a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:14.667183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000902-1703-4585-b76e-a5f18098117a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:14.668574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000902-1703-4585-b76e-a5f18098117a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-80000902-1703-4585-b76e-a5f18098117a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:14.681457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:14.682476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:14.683393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 503/1004] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 08:52:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:14.690981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:14.741657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10acaee-816c-4781-ad39-17d79833dc20 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:14.742053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10acaee-816c-4781-ad39-17d79833dc20 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:14.742423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10acaee-816c-4781-ad39-17d79833dc20 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:14.744043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 504/1005] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:14.749860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:14.750177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:14.750428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:14.767589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:14.768899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:14.769648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:14.801420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f91192-11e9-43ef-85fa-73bc35f38405 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:14.837968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:14.838731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:14.839091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:14.839449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:14.840274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:14.840650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:14.842130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:14.846690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 505/1006] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:14.847827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 502/1007] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:14.856473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:14.874834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:14.969264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:14.992675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160c1d6-a06f-4ef1-bfac-5d6d5196298f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:14.995773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110bb37-4aea-4c09-b3eb-a84d0580fe32 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:15.032546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:15.033219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:15.033505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:15.033779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:15.033887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c943e-ed90-423b-8eaa-641b34e5c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:15.034489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:15.034596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c943e-ed90-423b-8eaa-641b34e5c00f None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:15.034797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:15.034893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c943e-ed90-423b-8eaa-641b34e5c00f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:15.035081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c943e-ed90-423b-8eaa-641b34e5c00f None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:15.035844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c943e-ed90-423b-8eaa-641b34e5c00f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:15.036225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:15.037224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c943e-ed90-423b-8eaa-641b34e5c00f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:15.041727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 506/1008] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 08:52:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:15.046001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:15.048062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:15.059933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 503/1009] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:52:14 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:52:15.173971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f121d-645f-4053-b7f1-77f3fad7da14 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:15.219894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f4fd-b438-4f06-b2db-00f7dba0d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:15.220486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f4fd-b438-4f06-b2db-00f7dba0d3a1 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:15.220771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f4fd-b438-4f06-b2db-00f7dba0d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:15.221045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f4fd-b438-4f06-b2db-00f7dba0d3a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:15.221793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f4fd-b438-4f06-b2db-00f7dba0d3a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:15.223206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f4fd-b438-4f06-b2db-00f7dba0d3a1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:15.235425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:15.247977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 507/1010] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:52:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:52:16.036112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d9e91-000a-4fba-bfbf-4ce55498c74d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:16.036624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d9e91-000a-4fba-bfbf-4ce55498c74d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:16.036704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d9e91-000a-4fba-bfbf-4ce55498c74d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:16.038189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 504/1011] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:16.043691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:16.044106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:16.044293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:16.061159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:16.062328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:16.138372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 508/1012] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:16.161132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d9e91-000a-4fba-bfbf-4ce55498c74d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:16.267538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d9e91-000a-4fba-bfbf-4ce55498c74d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:16.303486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:16.304320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:16.304637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:16.304908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:16.305555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:16.306932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:16.318950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:16.320601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 08:52:16.321463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:16.323924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 505/1013] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:16.326900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:16.431050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812739e-677f-4b37-8ead-975eeed57d19 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:16.456999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:16.466911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:16.467587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:16.467903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:16.468183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:16.468896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:16.469206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:16.470581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:16.480021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 509/1014] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:16.481537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:16.546061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:16.586814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f3a00-ee7b-4af3-b400-22ed3a9c3465 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:16.620190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:16.620854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:16.621137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:16.621411 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:16.622113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:16.622418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:16.623899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20ca03-30fd-4dd4-b390-302dac54e0c8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:16.634030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 506/1015] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 08:52:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:16.635551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:16.750084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4247f-30f0-482b-9ac1-58b00d265af4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:16.794883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5bbe3-7f59-4006-aff5-a5e8dd33ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:16.795666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bbe3-7f59-4006-aff5-a5e8dd33ea65 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:16.796042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bbe3-7f59-4006-aff5-a5e8dd33ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:16.796457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bbe3-7f59-4006-aff5-a5e8dd33ea65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:16.797206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5bbe3-7f59-4006-aff5-a5e8dd33ea65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:16.798736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5bbe3-7f59-4006-aff5-a5e8dd33ea65 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:16.839928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 510/1016] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:52:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:17.355438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e41f1-599d-4888-a9e1-301a4ec8470f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.355993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e41f1-599d-4888-a9e1-301a4ec8470f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.355993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e41f1-599d-4888-a9e1-301a4ec8470f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.357402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 507/1017] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:17.362623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93051-13d1-4b40-ac1b-138f2ea7907b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.363024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93051-13d1-4b40-ac1b-138f2ea7907b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.363185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93051-13d1-4b40-ac1b-138f2ea7907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.379793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a5b93051-13d1-4b40-ac1b-138f2ea7907b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:17.380967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a5b93051-13d1-4b40-ac1b-138f2ea7907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:17.424736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:17.457372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 511/1018] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:17.480839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e41f1-599d-4888-a9e1-301a4ec8470f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:17.537206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885666-c011-4101-8da8-63768d45a764 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.537554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885666-c011-4101-8da8-63768d45a764 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.537775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88885666-c011-4101-8da8-63768d45a764 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.539892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 512/1019] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:17.545348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.545637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.546324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.565344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:17.566540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:17.592078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e41f1-599d-4888-a9e1-301a4ec8470f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:17.619720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:17.629369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:17.630384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.630564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.630847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.631684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:17.633424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:17.640225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 513/1020] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:17.644922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:17.645926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:17.647360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 508/1021] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jun 3 08:52:17 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:17.652560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:17.665764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:17.765091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8dadf-b145-4c57-9aaa-853a76a80522 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:17.766783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:17.777703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdacdd-e0c9-40bc-afea-7882e3e1b1c1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:17.803678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:17.804525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.804809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.805085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.805787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] RBAC: Adding query filter params (name=image) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:17.806098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:17.807620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:17.812946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 514/1022] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:17.813979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:17.814788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.815068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.815341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.816558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:17.818014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:17.818344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:17.819801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 509/1023] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:17.825687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:17.887421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:17.924330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423fd78-bc3e-442a-b132-7444537c3c9f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:17.936163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba0905-bb32-4d42-af3f-990a79f8c4bc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:17.961679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:17.962702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.963182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.963631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.964525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] RBAC: Adding query filter params (type=image) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:17.965030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:17.966701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:17.977974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 515/1024] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:17.979295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:17.979788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:17.980014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:17.980302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:17.980574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:17.981285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:17.982740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:18.018292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:18.031783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 510/1025] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:52:17 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:52:18.100858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac33f0-6f9c-48de-ba67-6d8c55aeeede None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:18.142182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:18.142789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:18.143073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:18.143348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:18.144187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] RBAC: Adding query filter params (interface=public, service_id=e8a0adf9d6554e24b65d7cabfeb4fe2e, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:18.144505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:18.145911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f608c4-1013-4f9b-93cf-a51867405804 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:18.156514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 516/1026] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:52:17 2022] GET /identity/v3/endpoints?service_id=e8a0adf9d6554e24b65d7cabfeb4fe2e&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:18.157836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:18.281223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e4c3-2ce4-4d5a-81b8-7c4a638bbab2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:18.293449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:18.320590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462258db-02d8-40f4-9fe2-6b2373975297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:18.321268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462258db-02d8-40f4-9fe2-6b2373975297 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:18.321543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462258db-02d8-40f4-9fe2-6b2373975297 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:18.321812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462258db-02d8-40f4-9fe2-6b2373975297 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:18.322486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462258db-02d8-40f4-9fe2-6b2373975297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:18.323888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462258db-02d8-40f4-9fe2-6b2373975297 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:18.330739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 511/1027] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:52:18 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 08:52:19.274885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511912-1fe8-478a-9cdb-83ba696bea3d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:19.275398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511912-1fe8-478a-9cdb-83ba696bea3d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:19.275398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511912-1fe8-478a-9cdb-83ba696bea3d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:19.277053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 517/1028] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:19.282463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:19.282886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:19.283086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:19.300551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:19.301667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:19.372091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 512/1029] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:19.395807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511912-1fe8-478a-9cdb-83ba696bea3d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:19.493391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:19.502057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511912-1fe8-478a-9cdb-83ba696bea3d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:19.540371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:19.541195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:19.541479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:19.541753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:19.552607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:19.561231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:19.562133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:19.562968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:19.567575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 518/1030] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 08:52:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:19.568594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:19.669378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17213f-3961-44af-9ace-b480657e43c1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:19.671725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:19.706105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:19.706730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:19.707013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:19.707288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:19.708064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:19.708372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:19.709753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:19.723274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 513/1031] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:52:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:19.724683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:19.827597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf25ea-1e6a-4872-9216-78580d507839 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:19.861252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:19.862052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:19.862331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:19.862603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:19.873987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:19.875456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:19.893079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:19.894021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:19.895023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:19.895023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:19.895023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:19.895023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:19.899604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 519/1032] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:19.900877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.016537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fac4-d644-4da5-a0e3-c238858e50bf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.054005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.054704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.054988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.055265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.056030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:20.056342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.057821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.074125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 514/1033] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:20.075451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.085693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.181846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6e06c-d7df-4851-a9b8-769c1944f36b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.216198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.217001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.217286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.217563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.225337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.226854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-357d46e0-98f8-4f4f-9e54-a35c14290dd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:52:20.241001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:20.242509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:20.248423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 520/1034] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:52:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:20.250902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.284413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.337760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e9df-1230-43c9-90ec-b428b416e2f0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.338274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e9df-1230-43c9-90ec-b428b416e2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.338274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e9df-1230-43c9-90ec-b428b416e2f0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.339717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 521/1035] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:20.344554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.344835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.345109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.361817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:20.363003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:20.367388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64398e-9016-47fe-bffb-294a0e7d5753 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.408370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.409038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.409316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.409587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.410556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:20.410716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.412184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.430237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 515/1036] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:20.430880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.436338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.439537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 522/1037] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:20.464901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.527443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.544907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb0baa-7c4f-49d4-9d7a-33743ca88eb7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.575891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0ded4-4657-4999-8b02-fdbf564c5692 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.580356 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b05b5-1e0c-4055-87da-962c0270511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.581015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b05b5-1e0c-4055-87da-962c0270511a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.581297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b05b5-1e0c-4055-87da-962c0270511a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.581570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b05b5-1e0c-4055-87da-962c0270511a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.611131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf7248-90b3-4426-b566-7b7efb9d1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.611876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf7248-90b3-4426-b566-7b7efb9d1f17 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.612160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf7248-90b3-4426-b566-7b7efb9d1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.612433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf7248-90b3-4426-b566-7b7efb9d1f17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.613651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf7248-90b3-4426-b566-7b7efb9d1f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.615126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf7248-90b3-4426-b566-7b7efb9d1f17 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.616872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 523/1038] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:20.618699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ad74-77bf-431d-9459-2dc0a2319c09 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.618990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ad74-77bf-431d-9459-2dc0a2319c09 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.619269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ad74-77bf-431d-9459-2dc0a2319c09 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.620654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 524/1039] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:20.622824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0ad74-77bf-431d-9459-2dc0a2319c09 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.658763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b05b5-1e0c-4055-87da-962c0270511a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.660283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b05b5-1e0c-4055-87da-962c0270511a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.688458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.725685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0ad74-77bf-431d-9459-2dc0a2319c09 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.743108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.764745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 516/1040] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 08:52:20.764948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.764948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.764948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.765238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.765328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.765417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.765417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.765582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.765582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.778355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:20.779780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:20.784051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 525/1041] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:52:20 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:52:20.784925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.859578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 517/1042] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:20.883704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:20.920584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd4ad-087b-4491-8b1f-cab8687fb20c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:20.944628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:20.965262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:20.965262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:20.965262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:20.965262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:20.977291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:20.978540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:20.998429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:20.999405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:21.000484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:21.000484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:21.000484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:21.000484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:21.001383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 526/1043] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:21.007025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.008599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8ad5-f10c-4a77-9586-1cf29b5967ce None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.025169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:21.053151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.053952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.054266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.054534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.055210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.056611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:21.068592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:21.069684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:21.070683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 518/1044] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jun 3 08:52:20 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:21.078065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.130969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1076df-52e0-4bde-b8cb-bf65dbd95527 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.170162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.170750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.171147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.171424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.172310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:21.172749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.173960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.187678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 527/1045] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:21.188733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5245-5343-41a4-8655-38f76afed9b9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.193796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.234097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:21.236530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.237423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.237871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.238450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.240191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:21.240672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.242261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.249733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 519/1046] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:21.255170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.306924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:21.310716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ed61-f871-4520-a665-84a4eb9a950c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.350745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.351714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.352029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.352295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.360681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.362645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.370881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435fdd-9e1c-43f9-a84f-9d41ca477bd8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:52:21.377205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:21.378498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:21.379457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:21.383721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 528/1047] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:21.385016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.409924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.410596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.410880 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.411153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.411961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] RBAC: Adding query filter params (type=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:21.412274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.413695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.423492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 520/1048] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:21.424456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.487851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:21.498493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460275-dc97-40e1-b85c-e498dd37f109 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.536601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.537361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.537716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.538063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.538959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:21.539073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6761133-c918-462f-a660-b2c0e4812a2f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.539380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.540929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.546712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:21.559074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 529/1049] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:21.560664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:21.583033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c97a3-2dcd-4c88-a0c0-8346acb98612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.583694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c97a3-2dcd-4c88-a0c0-8346acb98612 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.584439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c97a3-2dcd-4c88-a0c0-8346acb98612 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.584718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c97a3-2dcd-4c88-a0c0-8346acb98612 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.585484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c97a3-2dcd-4c88-a0c0-8346acb98612 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.587391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c97a3-2dcd-4c88-a0c0-8346acb98612 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.613468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 521/1050] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:52:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:52:21.684641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4b76e-eee8-478a-968c-a6bc11d62d1d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:21.730677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:21.731349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:21.731628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:21.731935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:21.732763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] RBAC: Adding query filter params (role.id=25391cb59b2649cd894181c320f6a35e, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=120533a970c74d98af45911ba7e6a375) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:21.733077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:21.734553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3f2b-181b-46a5-9fe8-6f9903979972 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:21.747798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 530/1051] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:21 2022] GET /identity/v3/role_assignments?user.id=120533a970c74d98af45911ba7e6a375&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=25391cb59b2649cd894181c320f6a35e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:23.093673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486967-6fea-445a-8b35-70edb1667a33 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.094212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486967-6fea-445a-8b35-70edb1667a33 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.094212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486967-6fea-445a-8b35-70edb1667a33 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.095802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 522/1052] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:23.100792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.101286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.101451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.117903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:23.119097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:23.126477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:23.192052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 531/1053] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:23.216348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69486967-6fea-445a-8b35-70edb1667a33 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:23.329489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69486967-6fea-445a-8b35-70edb1667a33 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:23.362834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:23.363638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.363968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.364247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.375637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:23.383775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:23.384704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:23.385570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:23.386817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 523/1054] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:52:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:23.390932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:23.507153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802153f-5a8b-4712-83ca-4c31e57374ba None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:23.543961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:23.544648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.544932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.545207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.545967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:23.546277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:23.547809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:23.558833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 532/1055] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:23.564445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:23.594149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:23.685728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71368e-305a-4186-909f-9787c0af82ca None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:23.721588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2175-db89-42b9-982e-17e31c5439ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:23.722536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2175-db89-42b9-982e-17e31c5439ff None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.722823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2175-db89-42b9-982e-17e31c5439ff None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.723097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2175-db89-42b9-982e-17e31c5439ff None admin] PATH_INFO: `/v3/users/108d477ecfcc420a88cbbb92e58d479a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.737550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2175-db89-42b9-982e-17e31c5439ff None admin] RBAC: Authorizing `identity:get_user(user_id=108d477ecfcc420a88cbbb92e58d479a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:23.739015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2175-db89-42b9-982e-17e31c5439ff None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:23.740966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 524/1056] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:23 2022] GET /identity/v3/users/108d477ecfcc420a88cbbb92e58d479a => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:23.746983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:23.750852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:23.850650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67074-0175-416c-b1aa-270df68589e6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:23.890979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:23.891644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.892018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.892295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.911619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326211c-a508-448d-bbeb-2e863044ab20 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.911950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326211c-a508-448d-bbeb-2e863044ab20 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.912208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326211c-a508-448d-bbeb-2e863044ab20 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.913608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 525/1057] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:23.918984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3c26-32c4-444a-ac32-fce3f450e80f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:23.919271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3c26-32c4-444a-ac32-fce3f450e80f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:23.919555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3c26-32c4-444a-ac32-fce3f450e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:23.937483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e45a3c26-32c4-444a-ac32-fce3f450e80f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:23.938684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e45a3c26-32c4-444a-ac32-fce3f450e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:23.977741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:23.979237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:23.982504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.009604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 526/1058] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:24.010934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126a8a-b006-4d58-a48a-dcf2addaaaa8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.011216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126a8a-b006-4d58-a48a-dcf2addaaaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.011525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126a8a-b006-4d58-a48a-dcf2addaaaa8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.012910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 527/1059] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:24.018201 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.018493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.018765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.037151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:24.038342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:24.041899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.092702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 533/1060] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:24.092702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.107803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 528/1061] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:24.108584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.189727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de26cb-b260-464e-98d5-28877e532a22 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.192385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.209594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6518015-7db6-49aa-b61a-430a1dec05bc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.225366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.226033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.226910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.227181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.245010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.245870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.246153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.246426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.247622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] RBAC: Authorizing `identity:get_project(project_id=80004240c69542c9a113220644848d0d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.249140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.250852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 529/1062] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/projects/80004240c69542c9a113220644848d0d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:24.251619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.263893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.294097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.295576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.356448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722ceb-1ffb-4160-91e1-5e7db6315d6e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.390034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.390765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.391039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.391309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.392896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 534/1063] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:24.393740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.397474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.405750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:24.413819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:24.414956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 530/1064] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:24.415871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.484267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.495201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e33ea-05ac-4999-aa94-9f63134a90d3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.518217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d66b-8207-4c2d-b4b9-02c2a9ee0bff None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.530150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.530813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.531100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.531380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.532631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=80004240c69542c9a113220644848d0d, user.id=108d477ecfcc420a88cbbb92e58d479a) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:24.532974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.534442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.541678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 535/1065] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/role_assignments?user.id=108d477ecfcc420a88cbbb92e58d479a&scope.project.id=80004240c69542c9a113220644848d0d&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:24.543015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.558997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.560044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.560357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.560744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.574675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.576437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:24.596827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:24.597801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:24.598827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:24.598827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:24.598827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:24.598827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:24.598827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 531/1066] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:24.604287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.622756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.663973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc9fa-b26e-47cb-92c1-caf8df40434b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.703572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.704363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.704651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.704928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.705718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:24.706029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.707449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.717842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 536/1067] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:24.723841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:24.726814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be16b0-fa3f-434e-9e1c-7102f7caa8fa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.753419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.771933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.772982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.773349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.773597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.774258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:24.774570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.775984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.795793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 532/1068] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:24.835003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1b9bb-0327-4444-8894-15dd5fc9f690 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:24.867451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:24.875082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:24.875985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:24.876273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:24.876553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:24.889928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:24.891437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:24.910066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:24.911122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:24.912053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:24.912053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:24.912053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:24.912053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:24.912053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 537/1069] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:24.917276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:25.034566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f8f0-1e12-48a7-9879-671c1c626e03 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:25.073751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:25.074426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:25.074709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:25.074984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:25.075709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:25.076102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:25.077506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:25.090082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 533/1070] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:25.095545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:25.205379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558973a-6a52-41f0-998a-70feac1a27b0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:25.239026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:25.239854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:25.240141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:25.240415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:25.248666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:25.250112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:52:25.263861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:25.265120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:25.266076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 538/1071] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:52:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:25.270950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:25.314952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:25.372911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d0db0-90fe-4d7c-908d-7b77bfdddd01 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:25.406081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:25.406744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:25.407023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:25.407294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:25.409983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:25.410297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:25.411772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:25.429315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 534/1072] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:52:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:25.434881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:25.481721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:25.537249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794135a-881d-474a-89f8-0cec9f7d1f7e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:25.572217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:25.573012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:25.573301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:25.573572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:25.584054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:25.585518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:25.602182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:25.603109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:25.604045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:25.604045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:25.604045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:25.604045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:25.604045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 539/1073] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:25.609130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:25.708881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:25.713076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7298-7143-483d-933e-20c9f957e731 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:25.748018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:25.748603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:25.748886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:25.749163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:25.749883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:25.750192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:25.751568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:25.763516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 535/1074] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:25.769068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:25.861765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:25.869570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1aff-64ca-4a70-b2a2-0da5625e9a6f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:25.902710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:25.903850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:25.904056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:25.904332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:25.913072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:25.915075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:52:25.930195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:25.931263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:25.932547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 540/1075] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:25.937164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:26.038140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ae7d-f080-4be3-b1f6-2cc5d76a36fe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:26.072246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:26.072912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:26.073195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:26.073470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:26.074252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:26.074563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:26.076027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6d9fe-de02-4293-b74d-6c9d3b9ad663 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:26.088056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 536/1076] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:26.093927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:26.197112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e7b32-bf69-47cf-b1f9-0123028d31fe None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:26.232782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf15bc-0b99-4323-9b0d-a1dc238d2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:26.233693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf15bc-0b99-4323-9b0d-a1dc238d2477 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:26.233967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf15bc-0b99-4323-9b0d-a1dc238d2477 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:26.234238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf15bc-0b99-4323-9b0d-a1dc238d2477 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/120533a970c74d98af45911ba7e6a375/roles/25391cb59b2649cd894181c320f6a35e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:26.236480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf15bc-0b99-4323-9b0d-a1dc238d2477 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=120533a970c74d98af45911ba7e6a375, role_id=25391cb59b2649cd894181c320f6a35e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:26.237945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf15bc-0b99-4323-9b0d-a1dc238d2477 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:26.256647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 541/1077] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:52:26 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/120533a970c74d98af45911ba7e6a375/roles/25391cb59b2649cd894181c320f6a35e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:52:26.826188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575aa4-1b02-40cd-99eb-22d318866b03 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:26.826811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575aa4-1b02-40cd-99eb-22d318866b03 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:26.826811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78575aa4-1b02-40cd-99eb-22d318866b03 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:26.828249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 537/1078] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:26.834136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:26.834421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:26.834693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:26.853254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:26.854473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:26.864675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:26.936401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 542/1079] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:26.959673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78575aa4-1b02-40cd-99eb-22d318866b03 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:26.980914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:27.089762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78575aa4-1b02-40cd-99eb-22d318866b03 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:27.129133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:27.130143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:27.130429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:27.130712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:27.144348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:27.152207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:27.153402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:27.154296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:27.155935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 538/1080] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:52:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:27.159825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:27.277586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824ab8-21e4-4c8a-a452-199d8bffbbf9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:27.314258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:27.314938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:27.315217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:27.315484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:27.316276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:27.316562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:27.317945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:27.326697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 543/1081] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:27.332631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:27.421323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:27.449907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816653b9-c22d-4afe-9363-690872e10b20 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:27.488916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:27.489784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:27.490066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:27.490332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] PATH_INFO: `/v3/users/108d477ecfcc420a88cbbb92e58d479a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:27.491549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] RBAC: Authorizing `identity:get_user(user_id=108d477ecfcc420a88cbbb92e58d479a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:27.493580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:27.495223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 539/1082] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:27 2022] GET /identity/v3/users/108d477ecfcc420a88cbbb92e58d479a => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:27.501277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:27.511598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:27.611460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af4e74-5856-4a74-86c8-91f12363074e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:27.657909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc93862-0cfc-49af-9b43-fc769b273cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:27.658778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc93862-0cfc-49af-9b43-fc769b273cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:27.659059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc93862-0cfc-49af-9b43-fc769b273cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:27.659329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc93862-0cfc-49af-9b43-fc769b273cc8 None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:27.660532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc93862-0cfc-49af-9b43-fc769b273cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=80004240c69542c9a113220644848d0d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:27.661974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc93862-0cfc-49af-9b43-fc769b273cc8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:27.669207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 544/1083] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:27 2022] GET /identity/v3/projects/80004240c69542c9a113220644848d0d => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:27.670713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:27.789590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1f57-f90f-4964-a6f1-d69810faf851 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:27.827627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308f63c-c126-41af-9b8e-e5e0f30de8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:27.828581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f63c-c126-41af-9b8e-e5e0f30de8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:27.828865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f63c-c126-41af-9b8e-e5e0f30de8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:27.829136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f63c-c126-41af-9b8e-e5e0f30de8f3 None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d/users/108d477ecfcc420a88cbbb92e58d479a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:27.831176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308f63c-c126-41af-9b8e-e5e0f30de8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=80004240c69542c9a113220644848d0d, user_id=108d477ecfcc420a88cbbb92e58d479a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:27.832696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308f63c-c126-41af-9b8e-e5e0f30de8f3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:27.849185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 540/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:52:27 2022] PUT /identity/v3/projects/80004240c69542c9a113220644848d0d/users/108d477ecfcc420a88cbbb92e58d479a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:52:28.599349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb068e-0f9c-4ef6-9b90-8feda9f0fbe6 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:28.599933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb068e-0f9c-4ef6-9b90-8feda9f0fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:28.599933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb068e-0f9c-4ef6-9b90-8feda9f0fbe6 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:28.601344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 545/1085] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:28.606787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:28.607151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:28.607507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:28.619857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:28.626072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:28.627985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:28.700708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 541/1086] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:28.724397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb068e-0f9c-4ef6-9b90-8feda9f0fbe6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:28.810235 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:28.839660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb068e-0f9c-4ef6-9b90-8feda9f0fbe6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:28.876944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:28.877672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:28.877953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:28.878224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:28.889591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:28.897683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:28.898836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:28.906674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 546/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 08:52:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:28.910458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:29.012759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aca72-eb03-4174-9a56-351b97fdacb7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:29.046649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:29.047335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:29.047618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:29.047925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:29.048698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:29.049009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:29.050693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:29.053445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:29.066162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 542/1088] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:52:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:29.067416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:29.168366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b49a-617a-4596-9666-9497ed01cda4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:29.204403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:29.205202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:29.205485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:29.205754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:29.207769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:29.217788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:29.219263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:29.237652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:29.238619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:29.239509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:29.239509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:29.239509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:29.239509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:29.243696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 547/1089] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:29.244748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:29.348175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571efb8-a629-49d8-92fb-1b3baecf26fd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:29.382698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:29.383363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:29.383646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:29.383952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:29.384687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:29.385004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:29.386366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:29.399055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 543/1090] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:29.404866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:29.506259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffd83e-8894-4dde-863c-47c92e11ca92 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:29.545199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:29.545992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:29.546276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:29.546554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:29.554207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:29.555667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:52:29.570690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:29.571686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:29.572672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 548/1091] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 08:52:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:29.577761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:29.635530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:29.677229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2e8c2-7177-407e-b6e8-0449deaef1b9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:29.711952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:29.712621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:29.712905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:29.713180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:29.714015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:29.714327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:29.715967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:29.733315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 544/1092] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 08:52:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:29.739097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:29.785780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:29.839496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb90e-2fb2-4692-b6fc-1fbbdb2336ec None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:29.884476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d523d1-6307-4663-b3a9-45a318b8107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:29.885162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d523d1-6307-4663-b3a9-45a318b8107c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:29.885437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d523d1-6307-4663-b3a9-45a318b8107c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:29.885718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d523d1-6307-4663-b3a9-45a318b8107c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:29.956737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d523d1-6307-4663-b3a9-45a318b8107c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:29.958193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d523d1-6307-4663-b3a9-45a318b8107c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.003970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.058012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 549/1093] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:30.063349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.161026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb558a-34fe-40b6-8ae6-2a1452056beb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.177397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.196504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.197344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.197618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.197883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.215377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.216972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.220714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1f14-24e3-45a3-8381-c50b2c620847 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.221004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1f14-24e3-45a3-8381-c50b2c620847 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.221285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b1f14-24e3-45a3-8381-c50b2c620847 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.222659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 550/1094] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:30.227960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.228245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.228526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:52:30.236179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:30.237250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:30.238191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:52:30.238191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:52:30.238191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:52:30.238191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:30.238191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 545/1095] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:30.243642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.245510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:30.246701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:30.315119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 551/1096] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:30.339294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.343343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be1201-93bd-4227-bf85-963154ac5f67 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.379822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.380487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.380767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.381035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.381753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:30.382058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.383463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.394583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 546/1097] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:30.400716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.414414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.429741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.439683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40c691-a42a-4389-8dc5-9d6bdea676eb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.480145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.481000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.481285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.481561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.494646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:30.505342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:30.506371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:30.507280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:30.507986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 552/1098] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:30.514909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157afd6a-31ad-449c-a4ad-3be19d8af2c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.515096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.551608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.552445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.552727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.553006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.561036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.562967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:52:30.578239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:30.579220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:30.580185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 547/1099] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:52:30.585349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.620432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca247d-2700-4096-81f1-97aab22b495e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.658201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.658878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.659157 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.659456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.660229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:30.660531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.661938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.664947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.672863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 553/1100] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:30.678887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.680156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.693078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0096cfe-f196-45c0-9564-9389dec16875 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.729019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.729848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.730135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.730440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.731225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:30.731537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.733084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.744762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 548/1101] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:30.750589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.779374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883173-c2ef-4321-9e70-b9a50e977252 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.815159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.816168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.816452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.816727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] PATH_INFO: `/v3/users/108d477ecfcc420a88cbbb92e58d479a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.817939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] RBAC: Authorizing `identity:get_user(user_id=108d477ecfcc420a88cbbb92e58d479a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.819381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.821117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 554/1102] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/users/108d477ecfcc420a88cbbb92e58d479a => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:30.826811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:30.854195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15291a79-1db7-4944-9a8b-e604b7ff38ad None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.887543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.888229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.888514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.888790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:30.889617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] RBAC: Adding query filter params (role.id=25391cb59b2649cd894181c320f6a35e, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=120533a970c74d98af45911ba7e6a375) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:30.889930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:30.891368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:30.892116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:30.897420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 549/1103] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/role_assignments?user.id=120533a970c74d98af45911ba7e6a375&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=25391cb59b2649cd894181c320f6a35e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:30.930629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec65d3a-e95a-463b-8f74-2623bb04c87c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:30.970055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:30.970734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:30.971014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:30.971285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:31.043288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:31.044809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:31.112688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:31.150111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 555/1104] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 08:52:31.156288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:31.172466 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:31.262807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656ea0-c75b-455f-8ff5-15e3015a4363 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:31.297611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46376c-7752-470b-bd70-fbdd2a2ca6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:31.298513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46376c-7752-470b-bd70-fbdd2a2ca6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:31.298792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46376c-7752-470b-bd70-fbdd2a2ca6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:31.299060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46376c-7752-470b-bd70-fbdd2a2ca6d0 None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:31.300542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46376c-7752-470b-bd70-fbdd2a2ca6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=80004240c69542c9a113220644848d0d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:31.302012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46376c-7752-470b-bd70-fbdd2a2ca6d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:31.303709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 550/1105] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:31 2022] GET /identity/v3/projects/80004240c69542c9a113220644848d0d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:31.310253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:31.414011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b4ce3-09eb-43c1-9fe9-82bd16b33deb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:31.449766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:31.450429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:31.450714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:31.450992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:31.451853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=80004240c69542c9a113220644848d0d, user.id=108d477ecfcc420a88cbbb92e58d479a) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:31.452167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:31.453604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd8f9-08d0-48b2-8266-ec1af973103a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:31.460245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 556/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:31 2022] GET /identity/v3/role_assignments?user.id=108d477ecfcc420a88cbbb92e58d479a&scope.project.id=80004240c69542c9a113220644848d0d&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:33.774755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428195a-e19b-40e2-acf8-27baefdbe707 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:33.775298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428195a-e19b-40e2-acf8-27baefdbe707 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:33.775298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428195a-e19b-40e2-acf8-27baefdbe707 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:33.776976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 551/1107] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:33.782287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:33.782759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:33.782859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:33.799921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:33.801347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:33.824478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:33.872430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 557/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:33.898607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428195a-e19b-40e2-acf8-27baefdbe707 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:33.982974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:34.003658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428195a-e19b-40e2-acf8-27baefdbe707 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:34.037660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a265-bf2b-4349-b039-4b9f25810979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:34.039038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a265-bf2b-4349-b039-4b9f25810979 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:34.039321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a265-bf2b-4349-b039-4b9f25810979 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:34.039624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a265-bf2b-4349-b039-4b9f25810979 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:34.041290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a265-bf2b-4349-b039-4b9f25810979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:34.043082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a265-bf2b-4349-b039-4b9f25810979 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:34.044398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 552/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:34.050404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:34.146764 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01e807-5310-4433-bf9f-282ad6ec223f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:34.180468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2646681-5f94-48f6-9d65-93ddc3cb294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:34.181131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2646681-5f94-48f6-9d65-93ddc3cb294f None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:34.181408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2646681-5f94-48f6-9d65-93ddc3cb294f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:34.181675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2646681-5f94-48f6-9d65-93ddc3cb294f None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:34.182371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2646681-5f94-48f6-9d65-93ddc3cb294f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:34.183829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2646681-5f94-48f6-9d65-93ddc3cb294f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:34.204600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 558/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:52:34 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:36.470716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9d0c-edb7-4be3-ab39-245babb9738b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:36.471253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9d0c-edb7-4be3-ab39-245babb9738b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:36.471253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9d0c-edb7-4be3-ab39-245babb9738b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:36.472677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 553/1111] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:36.478265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:36.478709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:36.478811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:36.495804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:36.496971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:36.507470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:36.563471 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 559/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:36.586866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9d0c-edb7-4be3-ab39-245babb9738b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:36.696672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9d0c-edb7-4be3-ab39-245babb9738b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:36.731796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:36.732612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:36.732893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:36.733163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] PATH_INFO: `/v3/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:36.734637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] RBAC: Authorizing `identity:get_role(role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:36.736048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:36.737427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 554/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:36 2022] GET /identity/v3/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:36.746646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:36.873182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecff6f-04ac-40ca-bf54-2e10029faded None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:36.906159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:36.907036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:36.907309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:36.907580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] PATH_INFO: `/v3/users/4c6c5d079b2b464e8b99c4994a448a79` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:36.920750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] RBAC: Authorizing `identity:get_user(user_id=4c6c5d079b2b464e8b99c4994a448a79)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:36.922184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:36.923841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 560/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:36 2022] GET /identity/v3/users/4c6c5d079b2b464e8b99c4994a448a79 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:36.929811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:36.950620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:37.031511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb961-236c-41b9-86a7-31ba0de9609c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:37.064310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:37.064943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:37.065224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:37.065496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:37.130078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:37.131534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:37.148704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:37.228335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 555/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:37.234204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:37.237964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:37.332010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a5ff-e5f9-4bc5-8246-b2a8f3d9f732 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:37.365706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92399-1c56-4fae-8238-5ac15751980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:37.367211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92399-1c56-4fae-8238-5ac15751980d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:37.367495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92399-1c56-4fae-8238-5ac15751980d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:37.367788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92399-1c56-4fae-8238-5ac15751980d None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:37.368967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92399-1c56-4fae-8238-5ac15751980d None admin] RBAC: Authorizing `identity:get_project(project_id=80004240c69542c9a113220644848d0d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:37.370419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92399-1c56-4fae-8238-5ac15751980d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:37.372129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 561/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:37 2022] GET /identity/v3/projects/80004240c69542c9a113220644848d0d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:37.378195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:37.474713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92428-343b-4065-8642-e100d465bc94 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:37.491899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:37.509941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:37.510599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:37.510880 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:37.511153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:37.512011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] RBAC: Adding query filter params (role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=80004240c69542c9a113220644848d0d, user.id=4c6c5d079b2b464e8b99c4994a448a79) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:37.512324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:37.513767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629820b-caee-4674-b85c-08c9514265e5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:37.520130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 556/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:37 2022] GET /identity/v3/role_assignments?user.id=4c6c5d079b2b464e8b99c4994a448a79&scope.project.id=80004240c69542c9a113220644848d0d&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:39.746619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1bd05-0587-4678-94ce-3ff942b6edb9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:39.747221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1bd05-0587-4678-94ce-3ff942b6edb9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:39.747221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1bd05-0587-4678-94ce-3ff942b6edb9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:39.748584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 562/1118] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:39.753759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:39.754138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:39.754299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:39.771277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:39.772490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:39.836040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 557/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:39.862509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1bd05-0587-4678-94ce-3ff942b6edb9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:39.932941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:39.963162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1bd05-0587-4678-94ce-3ff942b6edb9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:39.996245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:39.997164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:39.997384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:39.997652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] PATH_INFO: `/v3/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:39.999103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] RBAC: Authorizing `identity:get_role(role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:40.000502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:40.001854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 563/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:39 2022] GET /identity/v3/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:40.007624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:40.105058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340c2b-8042-429a-a6f3-d3c0576df20a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:40.115744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:40.139873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:40.140745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:40.141029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:40.141302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] PATH_INFO: `/v3/users/4c6c5d079b2b464e8b99c4994a448a79` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:40.142481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=4c6c5d079b2b464e8b99c4994a448a79)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:40.143966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:40.145592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 558/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:40 2022] GET /identity/v3/users/4c6c5d079b2b464e8b99c4994a448a79 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:40.152033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:40.261535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e809f-7cfb-487d-8499-6b5cc991c7c0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:40.295016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976d68-7990-4e86-add5-644ee016c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:40.295958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976d68-7990-4e86-add5-644ee016c4db None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:40.296200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976d68-7990-4e86-add5-644ee016c4db None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:40.296476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976d68-7990-4e86-add5-644ee016c4db None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:40.297656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd976d68-7990-4e86-add5-644ee016c4db None admin] RBAC: Authorizing `identity:get_project(project_id=80004240c69542c9a113220644848d0d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:40.299091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd976d68-7990-4e86-add5-644ee016c4db None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:40.301071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 564/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:40 2022] GET /identity/v3/projects/80004240c69542c9a113220644848d0d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:40.306968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:40.406002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fb6c7-9e10-40fe-8e24-ba3ed3dfc2a0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:40.440370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755699-61b3-4586-b299-9cb3b11f1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:40.441267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755699-61b3-4586-b299-9cb3b11f1b22 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:40.441551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755699-61b3-4586-b299-9cb3b11f1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:40.441830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755699-61b3-4586-b299-9cb3b11f1b22 None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d/users/4c6c5d079b2b464e8b99c4994a448a79/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:40.444085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755699-61b3-4586-b299-9cb3b11f1b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=80004240c69542c9a113220644848d0d, user_id=4c6c5d079b2b464e8b99c4994a448a79, role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:40.446206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755699-61b3-4586-b299-9cb3b11f1b22 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:40.459529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 559/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:52:40 2022] PUT /identity/v3/projects/80004240c69542c9a113220644848d0d/users/4c6c5d079b2b464e8b99c4994a448a79/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 08:52:42.675902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816fb9-9b81-4805-9f68-7688c5c5bb81 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:42.676438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816fb9-9b81-4805-9f68-7688c5c5bb81 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:42.676438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816fb9-9b81-4805-9f68-7688c5c5bb81 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:42.677829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 565/1124] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:42.683078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:42.683507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:42.683629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:42.700140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:42.701319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:42.730930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:42.770343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 560/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:42.795070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816fb9-9b81-4805-9f68-7688c5c5bb81 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:42.806196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:42.896116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816fb9-9b81-4805-9f68-7688c5c5bb81 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:42.932200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:42.932985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:42.933268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:42.933544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] PATH_INFO: `/v3/roles/9bc83492752d4de5bf9b57898fae7a9b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:42.935028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] RBAC: Authorizing `identity:get_role(role_id=9bc83492752d4de5bf9b57898fae7a9b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:42.936443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:42.937827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 566/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:42 2022] GET /identity/v3/roles/9bc83492752d4de5bf9b57898fae7a9b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:42.943612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:43.050512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7af407-caa1-4e47-9c2e-d7bd685e4e75 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:43.085747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:43.086621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:43.086904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:43.087171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] PATH_INFO: `/v3/users/4c6c5d079b2b464e8b99c4994a448a79` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:43.088379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] RBAC: Authorizing `identity:get_user(user_id=4c6c5d079b2b464e8b99c4994a448a79)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:43.089828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:43.091469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 561/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:42 2022] GET /identity/v3/users/4c6c5d079b2b464e8b99c4994a448a79 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:43.097141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:43.171043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:43.194013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032d6e-3967-4d4c-9af0-b2d7c4687200 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:43.228280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:43.228925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:43.229210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:43.229486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:43.294438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:43.295927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:43.369212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:43.394015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 567/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:43.400497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:43.435369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:43.503159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c89143-28bb-4cb0-a940-41c64a12f474 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:43.541796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc461bf0-12c6-40db-abf5-08f04e220758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:43.542660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc461bf0-12c6-40db-abf5-08f04e220758 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:43.542942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc461bf0-12c6-40db-abf5-08f04e220758 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:43.543214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc461bf0-12c6-40db-abf5-08f04e220758 None admin] PATH_INFO: `/v3/projects/80004240c69542c9a113220644848d0d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:43.544438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc461bf0-12c6-40db-abf5-08f04e220758 None admin] RBAC: Authorizing `identity:get_project(project_id=80004240c69542c9a113220644848d0d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:43.546347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc461bf0-12c6-40db-abf5-08f04e220758 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:43.549533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 562/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:43 2022] GET /identity/v3/projects/80004240c69542c9a113220644848d0d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:43.557470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:43.676012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed9545-2ad2-49f5-a24d-73beb587d261 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:43.716224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:43.716889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:43.717173 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:43.717449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:43.718273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] RBAC: Adding query filter params (role.id=9bc83492752d4de5bf9b57898fae7a9b, scope.project.id=80004240c69542c9a113220644848d0d, user.id=4c6c5d079b2b464e8b99c4994a448a79) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:43.718586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:43.720050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b24c14-b3a8-4b01-baaf-aecb94326728 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:43.727618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 568/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:43 2022] GET /identity/v3/role_assignments?user.id=4c6c5d079b2b464e8b99c4994a448a79&scope.project.id=80004240c69542c9a113220644848d0d&role.id=9bc83492752d4de5bf9b57898fae7a9b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:46.051600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d648a-fa97-42e9-ba6a-e1b3dc773acb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:46.052172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d648a-fa97-42e9-ba6a-e1b3dc773acb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:46.052172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d648a-fa97-42e9-ba6a-e1b3dc773acb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:46.053639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 563/1131] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:46.059170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:46.059631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:46.059726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:46.077077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:46.078196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:46.112847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:46.145702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 569/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:46.170642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d648a-fa97-42e9-ba6a-e1b3dc773acb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:46.277061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d648a-fa97-42e9-ba6a-e1b3dc773acb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:46.279325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:46.311513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7bdf2-f5b1-44e8-871f-80735d907f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:46.312350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7bdf2-f5b1-44e8-871f-80735d907f11 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:46.312632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7bdf2-f5b1-44e8-871f-80735d907f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:46.312907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7bdf2-f5b1-44e8-871f-80735d907f11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:46.314110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7bdf2-f5b1-44e8-871f-80735d907f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:46.315570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7bdf2-f5b1-44e8-871f-80735d907f11 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:46.317220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 564/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:46.323646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:46.422814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bded8c-1565-430c-bc4e-91d68fc63f17 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:46.457983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967a1f2-930a-4629-bbba-b19da4f8496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:46.458645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a1f2-930a-4629-bbba-b19da4f8496e None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:46.458928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a1f2-930a-4629-bbba-b19da4f8496e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:46.459202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967a1f2-930a-4629-bbba-b19da4f8496e None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:46.459972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967a1f2-930a-4629-bbba-b19da4f8496e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:46.461420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967a1f2-930a-4629-bbba-b19da4f8496e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:46.486770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 570/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:52:46 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:48.777362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b434f-765d-40c0-97cd-cf46a463aae3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:48.777898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b434f-765d-40c0-97cd-cf46a463aae3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:48.778100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b434f-765d-40c0-97cd-cf46a463aae3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:48.779476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 565/1135] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:48.784669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:48.785094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:48.785233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:48.802165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:48.803328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:48.820262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:48.869370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 571/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:48.895286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b434f-765d-40c0-97cd-cf46a463aae3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:48.999231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b434f-765d-40c0-97cd-cf46a463aae3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:49.032814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b872f1b-9885-4f02-8920-8439670f110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:49.033533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872f1b-9885-4f02-8920-8439670f110e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:49.033815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872f1b-9885-4f02-8920-8439670f110e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:49.034088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b872f1b-9885-4f02-8920-8439670f110e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:49.035258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b872f1b-9885-4f02-8920-8439670f110e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:49.037752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b872f1b-9885-4f02-8920-8439670f110e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:49.040160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 566/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:52:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:52:49.045908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:49.143912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f458706-501a-430c-bd28-9b3874a511ec None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:49.179733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f5b3-e6f1-4144-8e00-87c294279b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:49.180452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f5b3-e6f1-4144-8e00-87c294279b82 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:49.180734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f5b3-e6f1-4144-8e00-87c294279b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:49.181007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f5b3-e6f1-4144-8e00-87c294279b82 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:49.181732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f5b3-e6f1-4144-8e00-87c294279b82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:49.183193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f5b3-e6f1-4144-8e00-87c294279b82 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:49.204916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 572/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:52:49 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:52:51.535865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622fc13-e995-4dbc-a4d5-3b20eba10232 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:51.536583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622fc13-e995-4dbc-a4d5-3b20eba10232 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:51.536583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622fc13-e995-4dbc-a4d5-3b20eba10232 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:51.538691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 567/1139] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:52:51.544827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aaa94-b271-4881-8afb-714045912e83 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:51.545570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aaa94-b271-4881-8afb-714045912e83 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:51.545570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aaa94-b271-4881-8afb-714045912e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:51.563246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-533aaa94-b271-4881-8afb-714045912e83 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:51.564479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-533aaa94-b271-4881-8afb-714045912e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:51.566527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:51.634294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 573/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:51.658988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622fc13-e995-4dbc-a4d5-3b20eba10232 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:51.703776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:51.761104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622fc13-e995-4dbc-a4d5-3b20eba10232 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:51.794391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:51.795108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:51.795389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:51.795660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:51.805943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:51.813536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:51.814723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:51.820541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 568/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:51.821299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aaa94-b271-4881-8afb-714045912e83 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:51.918184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aaa94-b271-4881-8afb-714045912e83 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:51.951257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:51.951946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:51.952230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:51.952501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:51.953243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:51.953548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:51.954953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:51.960306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:51.964274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 574/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:51.970205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:52.066935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:52.070358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a770-ec71-47ec-a3e5-ab44e94d05e4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:52.103283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:52.104168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:52.104451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:52.104724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] PATH_INFO: `/v3/users/10bdade009b84cc29fa4c7c3cc07c438` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:52.117484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] RBAC: Authorizing `identity:get_user(user_id=10bdade009b84cc29fa4c7c3cc07c438)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:52.118926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:52.120564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 569/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:51 2022] GET /identity/v3/users/10bdade009b84cc29fa4c7c3cc07c438 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:52.126466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:52.223258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0af9e-5e88-4f2b-9136-6c615612ae47 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:52.255373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:52.256043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:52.256324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:52.257111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:52.320650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:52.322789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:52.324507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:52.419008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 575/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:52.425192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:52.522549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddbcf9-e331-4b27-9da1-86602d8812be None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:52.556771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065cae-369a-4319-8d90-3d962cf9419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:52.557629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065cae-369a-4319-8d90-3d962cf9419f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:52.557911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065cae-369a-4319-8d90-3d962cf9419f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:52.558189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065cae-369a-4319-8d90-3d962cf9419f None admin] PATH_INFO: `/v3/projects/cefb665823544ad4b02770289deaf3ab` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:52.559369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065cae-369a-4319-8d90-3d962cf9419f None admin] RBAC: Authorizing `identity:get_project(project_id=cefb665823544ad4b02770289deaf3ab)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:52.560865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065cae-369a-4319-8d90-3d962cf9419f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:52.562562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 570/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:52 2022] GET /identity/v3/projects/cefb665823544ad4b02770289deaf3ab => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:52.568704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:52.660666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:52.663713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9cae9-d803-4d7f-be08-2c8cedfa80d0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:52.698026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:52.698671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:52.698950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:52.699220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:52.700063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=cefb665823544ad4b02770289deaf3ab, user.id=10bdade009b84cc29fa4c7c3cc07c438) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:52.700371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:52.701793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4373496-6554-4474-9f6d-9fbcbd207e5b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:52.707142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 576/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:52 2022] GET /identity/v3/role_assignments?user.id=10bdade009b84cc29fa4c7c3cc07c438&scope.project.id=cefb665823544ad4b02770289deaf3ab&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:54.887053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d3d1-042b-41fa-8036-7becab47350e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:54.887615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d3d1-042b-41fa-8036-7becab47350e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:54.887615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d3d1-042b-41fa-8036-7becab47350e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:54.888956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 571/1147] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:54.894144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:54.894543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:54.894697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:54.911074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:54.912371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:54.978030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 577/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:52:55.001075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d3d1-042b-41fa-8036-7becab47350e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:55.028737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:55.103115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d3d1-042b-41fa-8036-7becab47350e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:55.136214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:55.136991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:55.137322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:55.137545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:55.147580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:55.155008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:55.156110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:52:55.157143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 572/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:55.162329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:55.252289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:55.259578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034efb7-06c1-4b27-950c-4d691abbc31d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:55.296210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:55.296882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:55.297159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:55.297432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:55.298175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:55.298479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:55.300145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:55.309139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 578/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:55.315095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:55.397590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:55.413357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7beecd-6201-4759-b070-501f93e87109 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:55.446672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:55.447539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:55.447850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:55.448128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] PATH_INFO: `/v3/users/10bdade009b84cc29fa4c7c3cc07c438` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:55.449311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] RBAC: Authorizing `identity:get_user(user_id=10bdade009b84cc29fa4c7c3cc07c438)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:55.450761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:55.452407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 573/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:55 2022] GET /identity/v3/users/10bdade009b84cc29fa4c7c3cc07c438 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:55.458132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:55.561436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775b4f5-46f8-45d2-9f8e-36235ef31899 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:55.597054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dc1ee-12f5-4bf3-9a23-9d8131fbb829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:55.598004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dc1ee-12f5-4bf3-9a23-9d8131fbb829 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:55.598279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dc1ee-12f5-4bf3-9a23-9d8131fbb829 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:55.598552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dc1ee-12f5-4bf3-9a23-9d8131fbb829 None admin] PATH_INFO: `/v3/projects/cefb665823544ad4b02770289deaf3ab` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:55.599785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dc1ee-12f5-4bf3-9a23-9d8131fbb829 None admin] RBAC: Authorizing `identity:get_project(project_id=cefb665823544ad4b02770289deaf3ab)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:55.601814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dc1ee-12f5-4bf3-9a23-9d8131fbb829 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:55.603529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 579/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:55 2022] GET /identity/v3/projects/cefb665823544ad4b02770289deaf3ab => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:55.609461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:55.708686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794c5f1-b930-4265-8732-79ab15913645 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:55.742344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14175fd1-76de-4ce1-99c6-655c3d49d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:55.743230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14175fd1-76de-4ce1-99c6-655c3d49d486 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:55.743509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14175fd1-76de-4ce1-99c6-655c3d49d486 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:55.743802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14175fd1-76de-4ce1-99c6-655c3d49d486 None admin] PATH_INFO: `/v3/projects/cefb665823544ad4b02770289deaf3ab/users/10bdade009b84cc29fa4c7c3cc07c438/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:55.745747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14175fd1-76de-4ce1-99c6-655c3d49d486 None admin] RBAC: Authorizing `identity:create_grant(project_id=cefb665823544ad4b02770289deaf3ab, user_id=10bdade009b84cc29fa4c7c3cc07c438, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:55.747190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14175fd1-76de-4ce1-99c6-655c3d49d486 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:55.760674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 574/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:52:55 2022] PUT /identity/v3/projects/cefb665823544ad4b02770289deaf3ab/users/10bdade009b84cc29fa4c7c3cc07c438/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:52:57.981093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bbba-a61e-476a-8597-e5f553382aa9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:57.981645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bbba-a61e-476a-8597-e5f553382aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:57.981645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bbba-a61e-476a-8597-e5f553382aa9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:57.983023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 580/1154] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:52:57.988515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:57.988909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:57.989062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:58.007188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:52:58.008524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:52:58.018920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:58.076700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 575/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:52:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:52:58.099962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0bbba-a61e-476a-8597-e5f553382aa9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:58.126126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:58.200018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0bbba-a61e-476a-8597-e5f553382aa9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:58.234048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:58.234762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:58.235042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:58.235309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:58.246322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:52:58.253831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:52:58.254966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:52:58.256183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 581/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:52:58.261094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:58.370704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb7dc-604b-48aa-8610-ab54d973e510 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:58.403795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:58.404459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:58.404738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:58.405010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:58.405744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:58.406048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:58.407412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:58.415923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 576/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:58.421697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:58.503255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:58.518381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6e371-edfb-4f3a-a8d7-aeda3069b1a6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:58.552389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:58.553250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:58.553525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:58.553813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] PATH_INFO: `/v3/users/10bdade009b84cc29fa4c7c3cc07c438` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:58.554981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] RBAC: Authorizing `identity:get_user(user_id=10bdade009b84cc29fa4c7c3cc07c438)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:58.556443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:58.558050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 582/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:52:58 2022] GET /identity/v3/users/10bdade009b84cc29fa4c7c3cc07c438 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:58.563907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:58.573061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:58.666573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a024-d41b-403d-a597-6cf2b45ce4a4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:58.699987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:58.700906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:58.701144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:58.701486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:58.768951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:58.770359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:58.778523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:58.868010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 577/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:52:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:52:58.873949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:58.971157 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c325-18b7-4ee7-8812-00ee6532ae5e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:59.005057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d304f8b-366a-4aa8-acc8-79b72c688688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:59.005925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304f8b-366a-4aa8-acc8-79b72c688688 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:59.006205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304f8b-366a-4aa8-acc8-79b72c688688 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:59.006476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304f8b-366a-4aa8-acc8-79b72c688688 None admin] PATH_INFO: `/v3/projects/cefb665823544ad4b02770289deaf3ab` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:59.008295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d304f8b-366a-4aa8-acc8-79b72c688688 None admin] RBAC: Authorizing `identity:get_project(project_id=cefb665823544ad4b02770289deaf3ab)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:59.010175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d304f8b-366a-4aa8-acc8-79b72c688688 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:59.012322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 583/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:52:58 2022] GET /identity/v3/projects/cefb665823544ad4b02770289deaf3ab => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:52:59.018867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:52:59.115562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed6c-000e-467e-ab0c-83a1abef2ca2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:52:59.122717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:52:59.150192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:52:59.150832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:52:59.151111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:52:59.151384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:52:59.152244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=cefb665823544ad4b02770289deaf3ab, user.id=10bdade009b84cc29fa4c7c3cc07c438) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:52:59.152557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:52:59.153990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c37c0c-0ca1-4480-82df-d26250e292c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:52:59.159722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 578/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:52:59 2022] GET /identity/v3/role_assignments?user.id=10bdade009b84cc29fa4c7c3cc07c438&scope.project.id=cefb665823544ad4b02770289deaf3ab&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:01.482988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7c98-0793-4665-87a5-9040ffc83ce4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:01.483552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7c98-0793-4665-87a5-9040ffc83ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:01.483552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7c98-0793-4665-87a5-9040ffc83ce4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:01.484950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 584/1162] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:01.490179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:01.490584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:01.490732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:01.507264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:01.508502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:01.574475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 579/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:01.597563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7c98-0793-4665-87a5-9040ffc83ce4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:01.620226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:01.698903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7c98-0793-4665-87a5-9040ffc83ce4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:01.732808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:01.733505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:01.733742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:01.734018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:01.800297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:01.801748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:01.821760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:01.896935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 585/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:53:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:53:01.903495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:02.000572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:02.003960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b794a-bae5-4e16-be9a-899364fa4ee7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:02.040917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:02.041727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:02.042034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:02.042309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:02.049066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:02.050773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-25fb912c-5b6e-49a5-9e1e-2f45a480c4df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:53:02.064774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:53:02.066001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:53:02.067044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 580/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:53:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:53:02.082534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:02.179893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764986-84cd-436c-b63f-14b74f83a4e1 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:02.199547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:02.213645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:02.214306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:02.214591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:02.214869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:02.215578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:53:02.215928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:02.217300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2126-66dd-4eac-86b8-8de16fe4a00e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:02.224425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 586/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 08:53:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:04.434602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a0bf-334a-4f58-b139-95e3c6473e50 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:04.435162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a0bf-334a-4f58-b139-95e3c6473e50 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:04.435162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a0bf-334a-4f58-b139-95e3c6473e50 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:04.436570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 581/1167] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:04.441682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb787601-2dbc-47a0-acf1-e38f948485e9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:04.442117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb787601-2dbc-47a0-acf1-e38f948485e9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:04.442239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb787601-2dbc-47a0-acf1-e38f948485e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:04.459086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fb787601-2dbc-47a0-acf1-e38f948485e9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:04.460298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fb787601-2dbc-47a0-acf1-e38f948485e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:04.523915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 587/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:04.546883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24a0bf-334a-4f58-b139-95e3c6473e50 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:04.647110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24a0bf-334a-4f58-b139-95e3c6473e50 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:04.687926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e7b5-81ca-48be-b278-d15767f9fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:04.688508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e7b5-81ca-48be-b278-d15767f9fda0 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:04.688794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e7b5-81ca-48be-b278-d15767f9fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:04.689072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e7b5-81ca-48be-b278-d15767f9fda0 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:04.689812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966e7b5-81ca-48be-b278-d15767f9fda0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:04.691190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966e7b5-81ca-48be-b278-d15767f9fda0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:04.707274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 582/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Fri Jun 3 08:53:04 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:53:06.966451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b969cd7-d952-4944-abe7-fd6a10384142 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:06.967005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b969cd7-d952-4944-abe7-fd6a10384142 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:06.967005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b969cd7-d952-4944-abe7-fd6a10384142 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:06.968421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 588/1170] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:06.973721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:06.974127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:06.974272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:06.991591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:06.992811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:07.006576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:07.061358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 583/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:07.085367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b969cd7-d952-4944-abe7-fd6a10384142 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:07.184636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b969cd7-d952-4944-abe7-fd6a10384142 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:07.198343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:07.218072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcf4c9-e1f1-42ab-899e-f91830d509da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:07.218868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcf4c9-e1f1-42ab-899e-f91830d509da None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:07.219150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcf4c9-e1f1-42ab-899e-f91830d509da None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:07.219427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcf4c9-e1f1-42ab-899e-f91830d509da None admin] PATH_INFO: `/v3/domains/52d9f084e72b4f649b54c1ddcf36f6e5` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:07.230214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcf4c9-e1f1-42ab-899e-f91830d509da None admin] RBAC: Authorizing `identity:get_domain(domain_id=52d9f084e72b4f649b54c1ddcf36f6e5)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:07.231703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcf4c9-e1f1-42ab-899e-f91830d509da None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:07.233352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 589/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Fri Jun 3 08:53:07 2022] GET /identity/v3/domains/52d9f084e72b4f649b54c1ddcf36f6e5 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:07.239448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:07.337033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443f131-2c41-4212-8093-cde8f5320a00 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:07.371200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7631fdc-53af-4ca9-b2cc-58ae61256655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:07.371876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631fdc-53af-4ca9-b2cc-58ae61256655 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:07.372161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631fdc-53af-4ca9-b2cc-58ae61256655 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:07.372500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631fdc-53af-4ca9-b2cc-58ae61256655 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:07.373147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7631fdc-53af-4ca9-b2cc-58ae61256655 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:07.374584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7631fdc-53af-4ca9-b2cc-58ae61256655 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:07.400134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 584/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:53:07 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:53:09.670309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c277-cc96-41af-8d09-5c42c9e927d7 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:09.670874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c277-cc96-41af-8d09-5c42c9e927d7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:09.670874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c277-cc96-41af-8d09-5c42c9e927d7 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:09.672246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 590/1174] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:09.677780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:09.678217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:09.678344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:09.683357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:09.696806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:09.698033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:09.764617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 585/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:09.790062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c277-cc96-41af-8d09-5c42c9e927d7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:09.890232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c277-cc96-41af-8d09-5c42c9e927d7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:09.923500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb21d-b4de-405b-a0fc-2386a8a77284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:09.924326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb21d-b4de-405b-a0fc-2386a8a77284 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:09.924875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb21d-b4de-405b-a0fc-2386a8a77284 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:09.925152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb21d-b4de-405b-a0fc-2386a8a77284 None admin] PATH_INFO: `/v3/domains/52d9f084e72b4f649b54c1ddcf36f6e5` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:09.926318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eb21d-b4de-405b-a0fc-2386a8a77284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=52d9f084e72b4f649b54c1ddcf36f6e5)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:09.927781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eb21d-b4de-405b-a0fc-2386a8a77284 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:09.929422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 591/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Fri Jun 3 08:53:09 2022] GET /identity/v3/domains/52d9f084e72b4f649b54c1ddcf36f6e5 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:09.935062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:10.033050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14410d50-91a9-473b-8c70-32dffbd22b2f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:10.061339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:10.066781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2bc5-f1af-4327-bb1d-104699d55bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:10.067452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2bc5-f1af-4327-bb1d-104699d55bc0 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:10.067737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2bc5-f1af-4327-bb1d-104699d55bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:10.068047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2bc5-f1af-4327-bb1d-104699d55bc0 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:10.068764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea2bc5-f1af-4327-bb1d-104699d55bc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:10.070755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea2bc5-f1af-4327-bb1d-104699d55bc0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:10.091047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 586/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:53:09 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 08:53:12.380583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030d6c1-ea58-4d44-a19c-badc23749489 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:12.381142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030d6c1-ea58-4d44-a19c-badc23749489 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:12.381142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030d6c1-ea58-4d44-a19c-badc23749489 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:12.382496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 592/1178] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:12.387652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:12.388092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:12.388253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:12.404818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:12.406014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:12.471607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 587/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:12.496186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030d6c1-ea58-4d44-a19c-badc23749489 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:12.539984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:12.597415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030d6c1-ea58-4d44-a19c-badc23749489 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:12.630711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:12.631434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:12.631714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:12.632015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:12.644689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:53:12.652694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:53:12.653836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:53:12.654977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 593/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:53:12.660574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:12.757787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347b3f8-577b-4781-938c-84d36791c60b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:12.775372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:12.793180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:12.793848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:12.794128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:12.794405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:12.795150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:53:12.795458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:12.796868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:12.805247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 588/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:12.811170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:12.907782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b69d74-d2df-4dbd-a1a7-321b5482d31d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:12.909234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:12.949706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:12.950574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:12.950861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:12.951126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] PATH_INFO: `/v3/users/67b43bff86524fffa396cb2a65efc0ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:12.964757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] RBAC: Authorizing `identity:get_user(user_id=67b43bff86524fffa396cb2a65efc0ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:12.966243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:12.967944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 594/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:53:12 2022] GET /identity/v3/users/67b43bff86524fffa396cb2a65efc0ca => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:53:12.973843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:13.079933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83ff9-7dbd-42dd-ae2d-2f2ebfa485fb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:13.114782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:13.115461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:13.115784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:13.116092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:13.164819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:13.186333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:13.187971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:13.289321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 589/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:53:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:53:13.297823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:13.403144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc294-5435-4491-9763-df567ae4bfd7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:13.437153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8269d-7534-47e5-b256-95a8af55d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:13.437950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8269d-7534-47e5-b256-95a8af55d0cf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:13.438230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8269d-7534-47e5-b256-95a8af55d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:13.438503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8269d-7534-47e5-b256-95a8af55d0cf None admin] PATH_INFO: `/v3/projects/4263525556584d8a909c2d517c959021` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:13.439685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8269d-7534-47e5-b256-95a8af55d0cf None admin] RBAC: Authorizing `identity:get_project(project_id=4263525556584d8a909c2d517c959021)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:13.441136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8269d-7534-47e5-b256-95a8af55d0cf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:13.442805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 595/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:53:13 2022] GET /identity/v3/projects/4263525556584d8a909c2d517c959021 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:13.448964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:13.527260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:13.547118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa181-001e-4c09-a362-3f396b535c1e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:13.580295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:13.580941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:13.581226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:13.581504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:13.582335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=4263525556584d8a909c2d517c959021, user.id=67b43bff86524fffa396cb2a65efc0ca) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:53:13.582650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:13.584120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78876031-6c5d-4ca3-932c-ee542745e395 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:13.590000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 590/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:53:13 2022] GET /identity/v3/role_assignments?user.id=67b43bff86524fffa396cb2a65efc0ca&scope.project.id=4263525556584d8a909c2d517c959021&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:15.821280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b620-131b-4f78-806b-103a86dc85b7 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:15.821850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b620-131b-4f78-806b-103a86dc85b7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:15.821850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b620-131b-4f78-806b-103a86dc85b7 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:15.823197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 596/1186] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:15.828497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:15.828881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:15.829054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:15.845618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:15.846805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:15.913341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 591/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:15.936136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b620-131b-4f78-806b-103a86dc85b7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:15.964321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:16.045094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b620-131b-4f78-806b-103a86dc85b7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:16.078066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:16.078791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:16.079075 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:16.079351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:16.089704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:53:16.097224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:53:16.098329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:53:16.099199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 597/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:53:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:53:16.104626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:16.177497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:16.202917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47348e-38b0-4b0d-b18b-3ac5dcfcb4c9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:16.236486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:16.237151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:16.237430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:16.237703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:16.238439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:53:16.238772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:16.240179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:16.248431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 592/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:16.254286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:16.347714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:16.361455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd34fb-f4d0-4f17-8ed9-654908a00d7b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:16.395572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:16.396551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:16.396862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:16.397792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] PATH_INFO: `/v3/users/67b43bff86524fffa396cb2a65efc0ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:16.398979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=67b43bff86524fffa396cb2a65efc0ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:16.400456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:16.402068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 598/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:53:16 2022] GET /identity/v3/users/67b43bff86524fffa396cb2a65efc0ca => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:16.407844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:16.505367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455bae3-280d-4da5-a62d-e6b496512010 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:16.538215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367aeed-48c1-4944-acb1-c182defb7752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:16.539159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367aeed-48c1-4944-acb1-c182defb7752 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:16.539435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367aeed-48c1-4944-acb1-c182defb7752 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:16.539724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367aeed-48c1-4944-acb1-c182defb7752 None admin] PATH_INFO: `/v3/projects/4263525556584d8a909c2d517c959021` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:16.541110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367aeed-48c1-4944-acb1-c182defb7752 None admin] RBAC: Authorizing `identity:get_project(project_id=4263525556584d8a909c2d517c959021)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:16.542567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367aeed-48c1-4944-acb1-c182defb7752 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:16.544288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 593/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:53:16 2022] GET /identity/v3/projects/4263525556584d8a909c2d517c959021 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:16.550506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:16.656194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4eec5-4aff-4a38-be10-0a00d93ce5d2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:16.696073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703bbc-1dbe-4eba-aa87-57fb0d10fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:16.697072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703bbc-1dbe-4eba-aa87-57fb0d10fb19 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:16.697351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703bbc-1dbe-4eba-aa87-57fb0d10fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:16.697619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703bbc-1dbe-4eba-aa87-57fb0d10fb19 None admin] PATH_INFO: `/v3/projects/4263525556584d8a909c2d517c959021/users/67b43bff86524fffa396cb2a65efc0ca/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:16.699963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96703bbc-1dbe-4eba-aa87-57fb0d10fb19 None admin] RBAC: Authorizing `identity:create_grant(project_id=4263525556584d8a909c2d517c959021, user_id=67b43bff86524fffa396cb2a65efc0ca, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:16.701413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96703bbc-1dbe-4eba-aa87-57fb0d10fb19 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:16.714237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 599/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:53:16 2022] PUT /identity/v3/projects/4263525556584d8a909c2d517c959021/users/67b43bff86524fffa396cb2a65efc0ca/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:53:18.946213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e85c-aa3e-4142-a753-b8449b85dac3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:18.946743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e85c-aa3e-4142-a753-b8449b85dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:18.946743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e85c-aa3e-4142-a753-b8449b85dac3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:18.948152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 594/1193] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:53:18.953294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:18.953743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:18.953842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:18.970416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:53:18.971615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:53:18.982399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:19.042003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 600/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:53:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:53:19.066666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992e85c-aa3e-4142-a753-b8449b85dac3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:19.070591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:19.173323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992e85c-aa3e-4142-a753-b8449b85dac3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:19.206165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:19.206884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:19.207168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:19.207443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:19.218119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:53:19.226120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:53:19.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:53:19.228276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 595/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:53:19.233503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:19.332930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe45803-52cd-4984-9355-3ba69ffeda84 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:19.366562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:19.367227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:19.367510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:19.367807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:19.368551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:53:19.368858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:19.370240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:19.378112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 601/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:19.384171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:19.444711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:19.481650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74977c-e868-4dfa-9f9f-9e7d5ee47bf5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:19.513801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:19.514649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:19.514927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:19.515197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] PATH_INFO: `/v3/users/67b43bff86524fffa396cb2a65efc0ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:19.516385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] RBAC: Authorizing `identity:get_user(user_id=67b43bff86524fffa396cb2a65efc0ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:19.517819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:19.519406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 596/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 08:53:19 2022] GET /identity/v3/users/67b43bff86524fffa396cb2a65efc0ca => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:19.525665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:19.536975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:19.625412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e94736-afe9-45bd-bddb-b449ebef7409 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:19.657525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:19.658170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:19.658455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:19.658732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:19.724781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:19.726813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:19.736224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:19.822704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 602/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:53:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:53:19.828562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:19.925910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab0737-96cf-4e67-944b-f166b296e0cf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:19.954400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:19.960274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2ce0a-485a-4d04-aac5-0185fff13162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:19.961123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ce0a-485a-4d04-aac5-0185fff13162 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:19.961396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ce0a-485a-4d04-aac5-0185fff13162 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:19.961661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ce0a-485a-4d04-aac5-0185fff13162 None admin] PATH_INFO: `/v3/projects/4263525556584d8a909c2d517c959021` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:19.962843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ce0a-485a-4d04-aac5-0185fff13162 None admin] RBAC: Authorizing `identity:get_project(project_id=4263525556584d8a909c2d517c959021)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:19.964324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ce0a-485a-4d04-aac5-0185fff13162 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:19.966007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 597/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 08:53:19 2022] GET /identity/v3/projects/4263525556584d8a909c2d517c959021 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:19.972254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:53:20.068333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0bd6-7279-45f0-846f-adbd3deefc61 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:53:20.077793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:53:20.103301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:53:20.104009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:53:20.104292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:53:20.104564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:53:20.105384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=4263525556584d8a909c2d517c959021, user.id=67b43bff86524fffa396cb2a65efc0ca) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:53:20.105696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:53:20.107139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c520c5-4ff2-4621-8eeb-c53a217cab17 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:53:20.112882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 603/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:53:19 2022] GET /identity/v3/role_assignments?user.id=67b43bff86524fffa396cb2a65efc0ca&scope.project.id=4263525556584d8a909c2d517c959021&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:53:30.110258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=14 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:22.175087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d65b3-afb3-4478-b573-08adc49637ba None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:22.175728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d65b3-afb3-4478-b573-08adc49637ba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:22.175728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d65b3-afb3-4478-b573-08adc49637ba None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:22.177544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 598/1201] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:54:22.183165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:22.183673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:22.183788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:22.203596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:22.204965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:22.295107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 604/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:22.324977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d65b3-afb3-4478-b573-08adc49637ba None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:22.459803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d65b3-afb3-4478-b573-08adc49637ba None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:22.511352 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:22.512265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:22.512614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:22.512890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:22.525628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:22.527358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:22.554302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:22.556707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:22.557707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:22.557707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:22.557707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:22.557707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:22.557707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 599/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:22.561875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:22.680892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032e973-d2b3-4c92-b997-d338a9d3362b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:22.719643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:22.727236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:22.728048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:22.728331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:22.728637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:22.729472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:22.729797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:22.731263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde58d0-f391-4bf1-8afa-fc736f600120 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:22.751038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 605/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:22.752889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:22.830939 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:22.889611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a9d3-88e5-4830-b976-9faf3a066163 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:22.929600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440a3c-7402-425b-b854-dc5dc27fed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:22.930247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440a3c-7402-425b-b854-dc5dc27fed3b None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:22.930590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440a3c-7402-425b-b854-dc5dc27fed3b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:22.930854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440a3c-7402-425b-b854-dc5dc27fed3b None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:22.931608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440a3c-7402-425b-b854-dc5dc27fed3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:22.933190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440a3c-7402-425b-b854-dc5dc27fed3b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:22.956732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 600/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 08:54:22 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:54:25.516554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0d60-2286-422d-8e10-04101194966c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:25.517168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0d60-2286-422d-8e10-04101194966c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:25.517294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0d60-2286-422d-8e10-04101194966c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:25.518704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 606/1206] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:25.525104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:25.525575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:25.525828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:25.545264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:25.546506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:25.630901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 601/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:25.657618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0d60-2286-422d-8e10-04101194966c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:25.802180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0d60-2286-422d-8e10-04101194966c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:25.840819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:25.841804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:25.842095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:25.842408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:25.857101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:54:25.865882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:25.867085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:25.868123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 607/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:54:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:25.873811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:25.918061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:25.990340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea261-14ac-47a0-90c7-28182df1b7e6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:26.029429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:26.030175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:26.030451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:26.030724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:26.031483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:26.031815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:26.033216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:26.046914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 602/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:54:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:26.048201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:26.106543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:26.165219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2da82-8cb4-49bd-9b23-7ce4f0600f9d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:26.213079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:26.213886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:26.214161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:26.214435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:26.226059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:26.227718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:26.248027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:26.249070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:26.252711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:26.252711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:26.252711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:26.252711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:26.252711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 608/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:26.256127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:26.382860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:26.385952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6afc-68f7-429e-a637-9d8b01d06f1e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:26.430937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:26.431636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:26.432948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:26.432948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:26.432948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:26.433243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:26.434592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:26.451310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 603/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:26.457039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:26.581280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7687e-0dd1-4f0b-8e59-00d536728d38 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:26.583193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:26.623988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:26.625389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:26.625687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:26.625913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:26.633968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:26.635379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:54:26.653561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:26.654909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:26.656125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:26.657762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 609/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:26.665401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:26.789502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928e60-3f1e-4c24-a5b9-804bbcb0bdf8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:26.832037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:26.832744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:26.833055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:26.833376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:26.834353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:26.834666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:26.836277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:26.857983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 604/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 08:54:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:26.865015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:26.981305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ea32d-be93-464f-99b3-a0adbfc362d9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:27.033841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:27.034502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:27.034792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:27.035064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:27.074841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:27.121107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:27.122544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:27.260960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 610/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:54:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:54:27.263401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:27.287106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:27.381781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d631a3-1794-48f0-a361-f6de39efe2a9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:27.420358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:27.421389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:27.421824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:27.422233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:27.434650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:27.436358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:27.465654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:27.466850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:27.467812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:27.467812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:27.467812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:27.467812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:27.467812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 605/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:27.472772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:27.541053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:27.587839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0287035-dde0-44c7-afd8-422826ebed57 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:27.624723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:27.625527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:27.625816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:27.626096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:27.626917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:27.627559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:27.629161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:27.643799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 611/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:27.648423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:27.734769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:27.773182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b142e05-f4b6-4d91-83a4-df2700c53cb3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:27.825178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:27.826624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:27.827240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:27.827911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:27.841276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:27.844656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:54:27.874538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:27.875928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:27.877187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:27.884189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 606/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:54:27.886047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:28.014265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02a6e-ff27-4bed-9d48-f5dcb42cb0c6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:28.040645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:28.054485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:28.055283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:28.055656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:28.056121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:28.057042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:28.057420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:28.058976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb9e7a-7e3a-4aaf-8b43-b357661e55eb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:28.074116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 612/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:28.080516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:28.200857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16a5d9-3fbd-4858-9937-2d9b3626a371 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:28.232528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:28.240039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:28.240832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:28.241166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:28.241506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:28.242559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=1c78bee52575447ca8f4e1bf2c7a3c03) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:28.242896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:28.244671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6069-721f-44e7-a109-7ffd787b2e90 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:28.259802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 607/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:54:28 2022] GET /identity/v3/role_assignments?user.id=1c78bee52575447ca8f4e1bf2c7a3c03&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:31.066797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7ad62-8282-4215-a195-ebd646f0ce00 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:31.067399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7ad62-8282-4215-a195-ebd646f0ce00 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:31.067399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7ad62-8282-4215-a195-ebd646f0ce00 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:31.068954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 613/1220] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:31.074099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:31.074526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:31.074722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:31.093085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:31.094311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:31.175807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 608/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:54:31.204459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7ad62-8282-4215-a195-ebd646f0ce00 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:31.337163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7ad62-8282-4215-a195-ebd646f0ce00 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:31.385622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:31.386742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:31.387135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:31.387508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:31.402537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:54:31.414721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:31.415959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:54:31.417061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:31.420174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 614/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:54:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:54:31.424589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:31.569732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdb6c-7b2c-4a17-ba8f-bece5a6dbd5e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:31.601172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:31.618156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:31.618993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:31.619396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:31.619842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:31.620714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:31.621626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:31.623629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:31.635563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 609/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:31.641557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:31.708872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:31.797960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55372e-7d02-4f5d-8e9b-f1dbfa0c0f25 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:31.849741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:31.850822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:31.851243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:31.851613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:31.864151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:31.865648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:31.885775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:31.886950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:31.887972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:31.887972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:31.887972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:31.887972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:31.887972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 615/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:31.893395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:32.023527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c10f0-49da-4c24-ac0d-f21de140ed96 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:32.068993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:32.069673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:32.069958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:32.070233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:32.070985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:32.071296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:32.073081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:32.088311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 610/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:32.095090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:32.210172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:32.218156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703542a0-7496-49b2-a02d-b15fec625c0b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:32.259967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:32.260923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:32.261140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:32.261523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:32.270051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:32.271781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:54:32.292447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:32.293579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:32.294755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 616/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:54:32.300395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:32.365298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:32.439005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e82dc-c949-4e31-8e95-3a599ed01c73 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:32.481428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:32.482420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:32.482835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:32.483266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:32.484700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:32.485106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:32.486682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:32.506157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 611/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 08:54:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:32.512561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:32.630956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e80c5-dbfc-4676-9a7d-78e600ff104c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:32.675002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:32.675841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:32.676717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:32.676948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:32.689790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:32.691465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:32.711496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:32.712778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:32.714227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:32.714227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:32.714227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:32.714227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:32.718077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 617/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:54:32.719328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:32.842636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f816-1e6c-4cfa-9b53-3e36c090aceb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:32.846162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:32.887017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:32.887862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:32.888265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:32.888524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:32.889370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:32.889722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:32.891344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:32.906906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 612/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:32.915547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:32.927112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:33.059987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0605dc8-ae0d-4710-b665-f267e5ef8841 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:33.101059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:33.102136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:33.102136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:33.102675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:33.112630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:33.114219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:54:33.132536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:33.134916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:33.137829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 618/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:54:33.139614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:33.286252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b15c6e-6432-4c80-9f8b-bee9a5e22c22 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:33.336665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:33.337827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:33.338323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:33.338833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:33.340169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:33.340488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:33.342183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e288-adc2-4743-87f0-065bbc50a585 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:33.362734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 613/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:33.369367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:33.441272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:33.491333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626e6b-e4b1-4de4-bcbf-141b8d76d55b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:33.550159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28178ee-a4ff-40d4-afdf-d6781cf1089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:33.551085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28178ee-a4ff-40d4-afdf-d6781cf1089d None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:33.551368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28178ee-a4ff-40d4-afdf-d6781cf1089d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:33.551643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28178ee-a4ff-40d4-afdf-d6781cf1089d None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/1c78bee52575447ca8f4e1bf2c7a3c03/roles/42dfaa8839ba4e668709d5fdcd47b276` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:33.573527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28178ee-a4ff-40d4-afdf-d6781cf1089d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=1c78bee52575447ca8f4e1bf2c7a3c03, role_id=42dfaa8839ba4e668709d5fdcd47b276)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:33.576304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28178ee-a4ff-40d4-afdf-d6781cf1089d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:33.592705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 619/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:54:33 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/1c78bee52575447ca8f4e1bf2c7a3c03/roles/42dfaa8839ba4e668709d5fdcd47b276 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:54:35.884056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076bcba-3caf-4330-94ba-70eb90cf0ebb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:35.884652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076bcba-3caf-4330-94ba-70eb90cf0ebb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:35.884652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076bcba-3caf-4330-94ba-70eb90cf0ebb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:35.885981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 614/1233] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:35.891891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:35.892401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:35.892830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:35.919066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:35.921643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:36.014686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 620/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 08:54:36.041057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076bcba-3caf-4330-94ba-70eb90cf0ebb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:36.072487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:36.165579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076bcba-3caf-4330-94ba-70eb90cf0ebb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:36.202919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:36.203718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:36.204022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:36.204309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:36.216882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:54:36.225912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:36.227198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:36.228115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 615/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 08:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:36.234621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:36.292581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:36.367485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58821edc-bc16-41df-bc00-6705bf4db60e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:36.409483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:36.410165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:36.411093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:36.411370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:36.412143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:36.412452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:36.413845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:36.423469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 621/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 08:54:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:36.429531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:36.536991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:36.560854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e44f2-b5a5-4ea2-8b70-88593af585ef None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:36.616831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:36.617641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:36.617925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:36.618200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:36.634488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:36.634488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:36.661061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:36.662146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:36.663055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:36.663055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:36.663055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:36.663055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:36.663055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 616/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:36.669404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:36.800893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f94e2a-bdca-4f7d-a8ed-bf2cc54dd637 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:36.820915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:36.852146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:36.853000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:36.853345 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:36.853638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:36.854371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:36.854686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:36.856204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:36.870270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 622/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:36.876226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:37.001480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b49c7f-deee-4ed5-bbe0-8e5dd11281cb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:37.041339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:37.042340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:37.042720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:37.043025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:37.046922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:37.055001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:37.056811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:54:37.073541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:37.074787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:37.075777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:37.079788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 617/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:37.080851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:37.195161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb867c-d635-4eb8-9120-fec06d58faed None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:37.231254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:37.231960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:37.232244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:37.232522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:37.233372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:37.233679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:37.235268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:37.255678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 623/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 08:54:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:37.261410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:37.376280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119fe29-3488-4912-81c8-bc9c38b6dafe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:37.413428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:37.414100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:37.414544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:37.414682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:37.491705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:37.500385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:37.502003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:37.640389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 618/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:54:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:54:37.646925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:37.680231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:37.775161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531c51-5f6e-44be-afa8-820109d3279e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:37.821475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:37.822383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:37.822729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:37.823012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:37.836152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:37.837639 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:37.855899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:37.857044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:37.857976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:37.857976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:37.857976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:37.857976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:37.857976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 624/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:37.863154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:37.968040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:37.977622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0f799-f51c-444f-be70-00ba05282586 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:38.020202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:38.021014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:38.021360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:38.021634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:38.022539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:38.022850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:38.024284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:38.038949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 619/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:38.045892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:38.145162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:38.169629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8eb2-e172-449b-8c37-95ecc21765e4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:38.206428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:38.207321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:38.207607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:38.207928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:38.214726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:38.216216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:54:38.230400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:38.231481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:38.232762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 625/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:38.237356 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:38.357586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5da188-6ef9-485c-8d2a-98be0b3ba137 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:38.399854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:38.400529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:38.400802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:38.401080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:38.402090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:38.402582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:38.404542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b37388-7d85-44de-8286-3ca36c36d018 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:38.418479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 620/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:38.424992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:38.540596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95971-26f2-44e0-8c7e-baabb1b094f8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:38.579738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:38.580429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:38.580715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:38.580993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:38.581872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] RBAC: Adding query filter params (role.id=42dfaa8839ba4e668709d5fdcd47b276, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=1c78bee52575447ca8f4e1bf2c7a3c03) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:38.582799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:38.584278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128c32a-1b55-4ec8-a574-b8391ba8a3ff None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:38.590212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 626/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:54:38 2022] GET /identity/v3/role_assignments?user.id=1c78bee52575447ca8f4e1bf2c7a3c03&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=42dfaa8839ba4e668709d5fdcd47b276 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:41.075280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d42b-3d35-4c8c-9942-b46eaafd5f6a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:41.075843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d42b-3d35-4c8c-9942-b46eaafd5f6a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:41.075843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d42b-3d35-4c8c-9942-b46eaafd5f6a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:41.077438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 621/1247] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:41.083780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:41.084362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:41.084362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:41.090009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:41.104288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:41.105586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:41.181191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 627/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:41.207812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d42b-3d35-4c8c-9942-b46eaafd5f6a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:41.229396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:41.332973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d42b-3d35-4c8c-9942-b46eaafd5f6a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:41.375862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:41.376804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:41.377129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:41.377500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:41.390145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:54:41.399577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:41.400763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:41.401804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 622/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:41.407203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:41.514169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82615e5b-9558-4001-a3cb-f55a86b66520 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:41.552414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:41.559437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:41.560334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:41.560651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:41.561013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:41.562074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:41.562426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:41.564082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:41.573011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 628/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:41.579056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:41.668441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:41.695510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c96b-3380-4bdf-bff9-4c80974858a9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:41.739342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:41.740165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:41.740451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:41.740718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:41.751845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:41.753327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:41.771205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:41.772319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:41.778098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:41.778098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:41.778098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:41.778098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:41.778098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 623/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 08:54:41.778441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:41.896626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385017-80ad-44e7-93ec-96e41d2d6c8a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:41.936647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:41.937414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:41.937716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:41.938083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:41.939072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:41.939421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:41.940978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:41.956063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 629/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:41.961798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:42.081277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e20ccd-83e1-4639-b693-1301d40d87a4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:42.110428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:42.120469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:42.121277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:42.121556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:42.121831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:42.130884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:42.132605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:54:42.148508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:42.149999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:42.151294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 624/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:42.155802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:42.217570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:42.264418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040340-5714-4991-8406-ed9c88a237d9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:42.305655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:42.306612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:42.306944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:42.307223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:42.308192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:42.308510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:42.310292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:42.330636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 630/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 08:54:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:42.337498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:42.465520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6b76f-04b3-463e-85ee-139cd2be3790 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:42.504846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:42.505582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:42.505919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:42.506249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:42.568183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:42.581215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:42.583224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:42.692046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 625/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:54:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 08:54:42.697838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:42.811971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48238392-e18e-4077-a6a3-accec7b9f5f8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:42.829168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:42.852195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:42.852999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:42.853294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:42.853570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:42.864456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:42.866228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:42.887545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:42.888662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:42.889627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:42.889627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:42.889627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:42.889627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:42.889627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 631/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:42.895469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:42.993250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:43.006774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e5a04-19f2-48cd-9b30-504035945e0e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:43.042861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:43.043549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:43.043852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:43.044140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:43.044868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:43.045175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:43.046593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:43.059900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 626/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:43.065909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:43.180535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150578-e2d0-4b2c-8a49-ab2c65ebab72 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:43.217343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:43.218150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:43.218430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:43.218702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:43.226130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:43.227613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:54:43.242331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:43.243485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:43.244756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 632/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:43.250000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:43.359690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2bd72-3d8a-46b2-a82c-857b34b15847 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:43.398171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:43.398860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:43.399137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:43.399406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:43.400251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:43.400555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:43.402036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eda7f-bdb9-4e5d-9a19-55e46a32640e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:43.416105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 627/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:54:43.422793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:43.451415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:43.531329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e32b-6583-4f31-a2dd-ea2c6e98cc74 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:43.569000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:43.569659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:43.569938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:43.570204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:43.571029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=1c78bee52575447ca8f4e1bf2c7a3c03) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:43.571336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:43.572809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf904-d5d8-449e-a91c-facbe95e1911 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:43.578992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 633/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:54:43 2022] GET /identity/v3/role_assignments?user.id=1c78bee52575447ca8f4e1bf2c7a3c03&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:45.921285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e70de-869c-4079-a0a6-769a093f918d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:45.921861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e70de-869c-4079-a0a6-769a093f918d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:45.921861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e70de-869c-4079-a0a6-769a093f918d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:45.923460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 628/1261] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:45.929167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:45.929574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:45.929731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:45.946341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:45.947536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:46.012956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 634/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:46.036756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e70de-869c-4079-a0a6-769a093f918d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:46.047721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:46.137272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e70de-869c-4079-a0a6-769a093f918d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:46.170921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:46.171748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:46.172016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:46.172294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:46.182530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:54:46.190130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:46.191239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:46.192171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 629/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:54:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:46.197350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:46.215538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:46.293879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac289fb-6adb-42d4-ae83-11cc72e2c473 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:46.327169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:46.327877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:46.328167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:46.328445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:46.329192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:46.329503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:46.330882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:46.339522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 635/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:46.345403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:46.411549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:46.444371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e15286-f4b7-4ff7-93fb-6fbb71ab8cfb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:46.480349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:46.481108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:46.481389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:46.481662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:46.492701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:46.494168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:46.511072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:46.512116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:46.513069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:46.513069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:46.513069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:46.513069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:46.513069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 630/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:46.518044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:46.597425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:46.615976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90336-6d17-483e-86eb-0f5984e25733 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:46.648825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:46.649513 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:46.649763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:46.650034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:46.650745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:46.651046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:46.652448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:46.663949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 636/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:46.669644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:46.786748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e2a6-e729-4c09-943d-0db7fe38c6be None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:46.806726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:46.821832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:46.822632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:46.822910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:46.823184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:46.830487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:46.831995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:54:46.845729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:46.846821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:46.848043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 631/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:46.852845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:46.949123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c03c-e1c1-4912-aaa3-d94913938a2e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:46.982420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:46.983090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:46.983374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:46.983650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:46.984509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:46.984821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:46.986255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:46.995539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:47.004778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 637/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 08:54:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:47.010400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:47.108941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd834a1-7a40-45b2-8602-3537792a0288 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:47.142088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:47.142871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:47.143154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:47.143427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:47.153871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:47.155316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:47.172869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:47.174325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:47.175432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:47.175432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:47.175432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:47.175432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:47.175432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 632/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:47.180637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:47.277198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81662dc4-5afd-49a7-9b13-97450ffd77bf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:47.312284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:47.312945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:47.313231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:47.313501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:47.314219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:47.314528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:47.315948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:47.327198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 638/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:47.333024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:47.367479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:47.434566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21e2c2-0fe4-4b5e-ad19-2a41d1879b76 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:47.466636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:47.467414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:47.467697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:47.467998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:47.475077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:47.476557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:54:47.490960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:47.492017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:47.493078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 633/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:47.498070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:47.554635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:47.594845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7daff1-8771-411b-87a5-6ee5de720509 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:47.627200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:47.627802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:47.628087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:47.628357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:47.629166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:47.629469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:47.630891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe1428-68c5-42bd-890b-87af2f57d121 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:47.642395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 639/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:47.648873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:47.744488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:47.754695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5068b-b7aa-438b-a89f-2fc4b66141e0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:47.790519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349afa-6b2b-4fd8-8287-6ee8c25198a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:47.791400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349afa-6b2b-4fd8-8287-6ee8c25198a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:47.791677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349afa-6b2b-4fd8-8287-6ee8c25198a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:47.791973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349afa-6b2b-4fd8-8287-6ee8c25198a9 None admin] PATH_INFO: `/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/1c78bee52575447ca8f4e1bf2c7a3c03/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:47.793912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8349afa-6b2b-4fd8-8287-6ee8c25198a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad54bc08bf24aa98879d84c5baf0904, user_id=1c78bee52575447ca8f4e1bf2c7a3c03, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:47.795348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8349afa-6b2b-4fd8-8287-6ee8c25198a9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:47.808451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 634/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 08:54:47 2022] PUT /identity/v3/projects/2ad54bc08bf24aa98879d84c5baf0904/users/1c78bee52575447ca8f4e1bf2c7a3c03/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 08:54:50.038038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ecf06-0260-45ce-bd59-316e007c5d93 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.038534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ecf06-0260-45ce-bd59-316e007c5d93 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.038651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ecf06-0260-45ce-bd59-316e007c5d93 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.039990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 640/1274] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:50.045092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.045467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.045651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.063001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:50.064243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:50.129598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 635/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:50.153356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ecf06-0260-45ce-bd59-316e007c5d93 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:50.252093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ecf06-0260-45ce-bd59-316e007c5d93 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:50.269344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:50.286258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:50.287054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.287340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.287615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.297657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 08:54:50.305553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:50.306646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:50.307660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 641/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 08:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:50.312817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:50.392617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:50.412307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33d250-d336-4210-865f-e9a75fa6a6a1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:50.446035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:50.446687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.446967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.447238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.448003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:50.448310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:50.449666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:50.458082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 636/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 08:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:50.463713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:50.562476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75b10-ca7b-4f8a-9d54-078c22e7ec12 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:50.595474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:50.596290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.596578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.596855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.607063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:50.608566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:50.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:50.626807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:50.628033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:50.628033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:50.628033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:50.628033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:50.628033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 642/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:50.633163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:50.736263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c8ca-ce59-48ba-bb13-8eda108ea89f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:50.776265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:50.776947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.777237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.777519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.778251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:50.778558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:50.779959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:50.792624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 637/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:50.798515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:50.829749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:50.897397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec778fe-2a1c-4b8a-a962-00a466905b0c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:50.930241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:50.931025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:50.931299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:50.931566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:50.938731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:50.940195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 08:54:50.953858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:50.954955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:50.956122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 643/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:50.960738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:50.966495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:51.059450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3c84c-79e9-4c75-8483-2c7a36c3e3e5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:51.091670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:51.092292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:51.092573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:51.092845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:51.093663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:51.093966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:51.095386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:51.112331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 638/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 08:54:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:51.118718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:51.206840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:51.216636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0062f9-bda1-41e9-9d1e-0d9033b8c2a6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:51.249424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:51.250062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:51.250339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:51.250609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:51.316460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:51.317943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:51.403250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:51.414537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 644/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 08:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 08:54:51.420309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:51.481244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:51.518205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b615d-3906-49a2-b038-9933e1af28bc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:51.551861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:51.552646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:51.552929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:51.553205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:51.563023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:51.564520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 08:54:51.583437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:51.584569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:51.585527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 08:54:51.585527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 08:54:51.585527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 08:54:51.585527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:51.585527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 639/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:51.590289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:51.688846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced783-1434-4574-acfb-84d85fd1105d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:51.722162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:51.723407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:51.723704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:51.724013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:51.724706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:51.725019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:51.726399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:51.740140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 645/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 08:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:51.745758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:51.847146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bcfa8-c2ab-40bf-b27c-da66cc008fe2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:51.861213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:51.883407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:51.884222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:51.884509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:51.884784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:51.891415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:51.892906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 08:54:51.906405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:51.907459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 08:54:51.908831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 640/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 08:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:51.913901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:51.963245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:52.013554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484de97-4717-4f20-9d65-f83985147da9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:52.049197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:52.050309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:52.050626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:52.050906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:52.051697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:52.052126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:52.053791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946006e-5491-483a-8aee-e8163943d34c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:52.068033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 646/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 08:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:52.074249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:52.171537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abeb3c-cee9-4f21-b20d-be057a2a9453 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:52.203695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:52.204359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:52.204639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:52.204909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:52.205728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] RBAC: Adding query filter params (role.id=b88322e1806b4d37b60ebeb7b136d88c, scope.project.id=2ad54bc08bf24aa98879d84c5baf0904, user.id=1c78bee52575447ca8f4e1bf2c7a3c03) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:52.206036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:52.208024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bce8e-ec58-4e96-9f73-ccd65b13bfb9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:52.213759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 641/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 08:54:52 2022] GET /identity/v3/role_assignments?user.id=1c78bee52575447ca8f4e1bf2c7a3c03&scope.project.id=2ad54bc08bf24aa98879d84c5baf0904&role.id=b88322e1806b4d37b60ebeb7b136d88c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:54.459695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112963e1-c281-43b5-afe5-2f142e07dada None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:54.460373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112963e1-c281-43b5-afe5-2f142e07dada None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:54.460373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112963e1-c281-43b5-afe5-2f142e07dada None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:54.461643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 647/1288] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:54.466708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:54.467116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:54.467268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:54.484240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:54.485448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:54.515188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:54.552694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 642/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:54.575614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112963e1-c281-43b5-afe5-2f142e07dada None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:54.674964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112963e1-c281-43b5-afe5-2f142e07dada None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:54.685712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:54.708452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:54.709249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:54.709531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:54.709875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] PATH_INFO: `/v3/services/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:54.710460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:54.711906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:54:54.727423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:54:54.728833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:54:54.734971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 648/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:54:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:54:54.736024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:54.847999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d59e19-6aff-44f5-8324-403707c97eb9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:54.880557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:54.881203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:54.881480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:54.881747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:54.882447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:54.882745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:54.884137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c502-7abc-4c2e-a9fe-ca5681297f1e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:54.888814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 643/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 08:54:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:54.894542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:54.993297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30790-c073-41ab-b4cd-367bf948a3da None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:55.025554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:55.026211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:55.026489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:55.026760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:55.027448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:54:55.027769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:55.029139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd22d5-ad96-4f19-a048-7b29d4f6aa95 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:55.033522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 649/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 08:54:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:54:57.241072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62032d-28cb-48e7-9312-562b387b6fd1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:57.241590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62032d-28cb-48e7-9312-562b387b6fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:57.241590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62032d-28cb-48e7-9312-562b387b6fd1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:57.242909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 644/1293] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:57.248271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6913-e542-4c0a-9ebf-636f58441ad4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:57.248714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6913-e542-4c0a-9ebf-636f58441ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:57.248843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6913-e542-4c0a-9ebf-636f58441ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:57.265508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-16af6913-e542-4c0a-9ebf-636f58441ad4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:57.266708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-16af6913-e542-4c0a-9ebf-636f58441ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:57.296472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:57.334669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 650/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:57.357907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62032d-28cb-48e7-9312-562b387b6fd1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:54:57.388487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:54:57.462496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62032d-28cb-48e7-9312-562b387b6fd1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:54:57.496924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b3d9e-b5f0-4694-908b-46299183d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:54:57.497502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3d9e-b5f0-4694-908b-46299183d4e5 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:57.497778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3d9e-b5f0-4694-908b-46299183d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:57.498050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3d9e-b5f0-4694-908b-46299183d4e5 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:57.498769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3d9e-b5f0-4694-908b-46299183d4e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:54:57.500163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3d9e-b5f0-4694-908b-46299183d4e5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:54:57.512738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 645/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 08:54:57 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:54:59.782194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25f8d-0908-4f5c-9a3b-20086e155f02 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:59.782758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25f8d-0908-4f5c-9a3b-20086e155f02 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:59.783025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25f8d-0908-4f5c-9a3b-20086e155f02 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:59.786436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 651/1296] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:54:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:54:59.791650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:54:59.792110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:54:59.792240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:54:59.811033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:54:59.812270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:54:59.883968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 646/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:54:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:54:59.906395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25f8d-0908-4f5c-9a3b-20086e155f02 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:00.006734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25f8d-0908-4f5c-9a3b-20086e155f02 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:00.039552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:00.040371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:00.040651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:00.040921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:00.041562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:00.042917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:55:00.054637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:55:00.055659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:55:00.056591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 652/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:54:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:55:00.061903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:00.079573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:55:00.159361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b3fed-6082-4f8d-bd68-d7593f2ed56b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:00.193508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:00.194155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:00.194431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:00.194699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:00.195391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] RBAC: Adding query filter params (name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:55:00.195692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:00.197087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:00.202254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 647/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 08:55:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 08:55:00.208351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:00.239449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:55:00.307505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be03d0-d19a-408e-93e5-2bd340e0eb5a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:00.339769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:00.340442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:00.340729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:00.341010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:00.341792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] RBAC: Adding query filter params (interface=public, service_id=a9ef652ffdef4d2d97c0f0f6169aeb9e, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:55:00.342108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:00.343485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883e3a9-d811-41b4-9524-77fb6a2ff315 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:00.349027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 653/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 08:55:00 2022] GET /identity/v3/endpoints?service_id=a9ef652ffdef4d2d97c0f0f6169aeb9e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:55:00.354654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:00.434609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:55:00.452654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ab1a-ff82-4f4f-9dfe-6d79ae1e5fde None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:00.485715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eec396-b2b3-4c32-995b-c39b85388b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:00.486510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eec396-b2b3-4c32-995b-c39b85388b1e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:00.486665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eec396-b2b3-4c32-995b-c39b85388b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:00.486945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eec396-b2b3-4c32-995b-c39b85388b1e None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:00.487699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eec396-b2b3-4c32-995b-c39b85388b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:00.489603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eec396-b2b3-4c32-995b-c39b85388b1e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:00.496710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 648/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 08:55:00 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 08:55:02.726322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891a97-9e18-4251-b438-e4ecdedde703 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:02.726892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891a97-9e18-4251-b438-e4ecdedde703 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:02.726892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891a97-9e18-4251-b438-e4ecdedde703 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:02.728277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 654/1302] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:55:02.733431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:02.733841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:02.733986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:02.750912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:55:02.752128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:55:02.819143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 649/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:55:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 08:55:02.841895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891a97-9e18-4251-b438-e4ecdedde703 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:02.934640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:55:02.941355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891a97-9e18-4251-b438-e4ecdedde703 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:02.974497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:02.975307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:02.975590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:02.975900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:02.976604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:02.977927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 08:55:02.989818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 08:55:02.990956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 08:55:02.991883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 655/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 08:55:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 08:55:02.997061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:03.070418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:55:03.093285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0eebb-f374-43d6-9a9a-c53bdf51eca8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:03.126293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:03.126947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:03.127229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:03.127502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:03.128303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 08:55:03.128604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:03.129980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a177fd6-2c6a-4665-9fd5-3f6c808c1e9d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:03.135261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 650/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 08:55:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 08:55:03.142373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:55:03.243039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11a41a-6fa9-4016-9737-338ead8d77b0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:55:03.277310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46048ce9-3d5c-4e93-b6f3-fcbe9a25ff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:55:03.277982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46048ce9-3d5c-4e93-b6f3-fcbe9a25ff3d None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:55:03.278269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46048ce9-3d5c-4e93-b6f3-fcbe9a25ff3d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:55:03.278549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46048ce9-3d5c-4e93-b6f3-fcbe9a25ff3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:55:03.279281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46048ce9-3d5c-4e93-b6f3-fcbe9a25ff3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:55:03.280713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46048ce9-3d5c-4e93-b6f3-fcbe9a25ff3d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:55:03.301367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 656/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 08:55:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 08:55:13.132278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=30 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:55:13.296044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:10.167806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176441-7d9b-477a-a7ec-17ced360b3e4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:10.168386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176441-7d9b-477a-a7ec-17ced360b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:10.168386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176441-7d9b-477a-a7ec-17ced360b3e4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:10.175656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c566d-7552-4c9a-9d5c-738710c96c57 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:10.176191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c566d-7552-4c9a-9d5c-738710c96c57 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:10.176287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c566d-7552-4c9a-9d5c-738710c96c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:10.178363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 651/1307] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:10.252820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b25c566d-7552-4c9a-9d5c-738710c96c57 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:10.253953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b25c566d-7552-4c9a-9d5c-738710c96c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:10.372211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 657/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:56:10.413208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786406-d575-49f7-9886-09c74a9b8243 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:10.413817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786406-d575-49f7-9886-09c74a9b8243 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:10.414269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786406-d575-49f7-9886-09c74a9b8243 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:10.416111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 652/1309] 10.222.0.61 () {54 vars in 964 bytes} [Fri Jun 3 08:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:10.422597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d13f3-da4b-409d-9181-071aa8943cf8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:10.423440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d13f3-da4b-409d-9181-071aa8943cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:10.423725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d13f3-da4b-409d-9181-071aa8943cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:10.511167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0f5d13f3-da4b-409d-9181-071aa8943cf8 None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:10.512704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0f5d13f3-da4b-409d-9181-071aa8943cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:10.538276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:10.643442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 658/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Jun 3 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:10.652306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786406-d575-49f7-9886-09c74a9b8243 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:10.654099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0e786406-d575-49f7-9886-09c74a9b8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:10.881686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786406-d575-49f7-9886-09c74a9b8243 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:10.976865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:10.977838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:10.978338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:10.978806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:10.980719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:11.047964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:11.110640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:11.112138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1fde1-8ae5-4e83-a594-68e812f9404a service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:11.134245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 653/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:13.755376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52a9e-a196-4d26-99a8-2f9f6883f0f6 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:13.755909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52a9e-a196-4d26-99a8-2f9f6883f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:13.755909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52a9e-a196-4d26-99a8-2f9f6883f0f6 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:13.757292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 659/1312] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:13.763020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541314ec-1020-4738-929c-bd386455f4dc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:13.763423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541314ec-1020-4738-929c-bd386455f4dc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:13.763666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541314ec-1020-4738-929c-bd386455f4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:13.852769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-541314ec-1020-4738-929c-bd386455f4dc None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:13.854139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-541314ec-1020-4738-929c-bd386455f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:13.973857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 654/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:14.014005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b52a9e-a196-4d26-99a8-2f9f6883f0f6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:14.015513 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-15b52a9e-a196-4d26-99a8-2f9f6883f0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:14.146722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b52a9e-a196-4d26-99a8-2f9f6883f0f6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:14.232090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:14.235132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:14.236622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:14.237143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:14.237647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:14.239809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:14.487900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:14.489495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747003-c112-4601-a5af-4931cabf42b5 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:14.518322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 660/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:17.082193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeedc7-e1be-48f8-b84a-588a2b2b67f9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:17.082719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeedc7-e1be-48f8-b84a-588a2b2b67f9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:17.082811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeedc7-e1be-48f8-b84a-588a2b2b67f9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:17.084168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 655/1315] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:17.089428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28a76c-6d7f-4a24-a5dc-cebf208ed0ab None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:17.089820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28a76c-6d7f-4a24-a5dc-cebf208ed0ab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:17.089984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28a76c-6d7f-4a24-a5dc-cebf208ed0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:17.152289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7b28a76c-6d7f-4a24-a5dc-cebf208ed0ab None None] MFA Rules not processed for user `75faa1ace44b41f89a9a5c74487a0819`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:17.153481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7b28a76c-6d7f-4a24-a5dc-cebf208ed0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:17.204934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:17.254492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 661/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:17.293539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeedc7-e1be-48f8-b84a-588a2b2b67f9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:17.295092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-edaeedc7-e1be-48f8-b84a-588a2b2b67f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:17.305678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:17.400132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeedc7-e1be-48f8-b84a-588a2b2b67f9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:17.471641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:17.472310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:17.472592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:17.472861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:17.474506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:17.535866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:17.583673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:17.585166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019bd96-b624-4d69-849b-9d7d294943bc service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:17.603430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 656/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:20.455246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2a51-2608-4c00-bc15-ffc77cd232cd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:20.455789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2a51-2608-4c00-bc15-ffc77cd232cd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:20.455904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2a51-2608-4c00-bc15-ffc77cd232cd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:20.457199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 662/1318] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:20.462632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3ae2-b82c-4fbe-81e5-ec978b3bd92d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:20.463056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3ae2-b82c-4fbe-81e5-ec978b3bd92d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:20.463190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3ae2-b82c-4fbe-81e5-ec978b3bd92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:20.526441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-becd3ae2-b82c-4fbe-81e5-ec978b3bd92d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:20.546813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-becd3ae2-b82c-4fbe-81e5-ec978b3bd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:20.629524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 657/1319] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:20.667577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2a51-2608-4c00-bc15-ffc77cd232cd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:20.669119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-481d2a51-2608-4c00-bc15-ffc77cd232cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:20.774154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2a51-2608-4c00-bc15-ffc77cd232cd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:20.846396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:20.847043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:20.847327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:20.847642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:20.849269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:20.856080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:20.970641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:20.972057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13934f-ad75-4b99-87f9-650f9b503183 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:20.990470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 663/1320] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:23.992194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ad6c-a6a3-4be7-95fe-58a460ae2896 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:23.992602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ad6c-a6a3-4be7-95fe-58a460ae2896 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:23.992751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ad6c-a6a3-4be7-95fe-58a460ae2896 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:23.994166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 658/1321] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:23.999442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623128f-61f1-4b0f-a7c6-a318823e5691 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:23.999883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623128f-61f1-4b0f-a7c6-a318823e5691 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:24.000027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623128f-61f1-4b0f-a7c6-a318823e5691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:24.067377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d623128f-61f1-4b0f-a7c6-a318823e5691 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:24.068598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d623128f-61f1-4b0f-a7c6-a318823e5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:24.126149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:24.165759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 664/1322] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:24.201159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ad6c-a6a3-4be7-95fe-58a460ae2896 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:24.202747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dec5ad6c-a6a3-4be7-95fe-58a460ae2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:24.223742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:24.317406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ad6c-a6a3-4be7-95fe-58a460ae2896 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:24.394339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:24.395016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:24.395280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:24.395557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:24.397251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:24.478396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:24.523180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:24.524671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70265913-b81e-438e-9745-7685215e1985 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:24.543644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 659/1323] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:26.909577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90716ace-a7d1-4434-a35c-a90d9397bcc0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:26.910372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90716ace-a7d1-4434-a35c-a90d9397bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:26.910372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90716ace-a7d1-4434-a35c-a90d9397bcc0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:26.911522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 665/1324] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:26.917240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa56982-66f2-4c0f-b692-b4c8f9a87197 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:26.917987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa56982-66f2-4c0f-b692-b4c8f9a87197 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:26.917987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa56982-66f2-4c0f-b692-b4c8f9a87197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:26.990431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-faa56982-66f2-4c0f-b692-b4c8f9a87197 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:26.991647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-faa56982-66f2-4c0f-b692-b4c8f9a87197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:27.109809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 660/1325] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:27.146759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90716ace-a7d1-4434-a35c-a90d9397bcc0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:27.148394 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-90716ace-a7d1-4434-a35c-a90d9397bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:27.272421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90716ace-a7d1-4434-a35c-a90d9397bcc0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:27.358766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:27.359422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:27.359702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:27.360022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:27.361702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:27.382200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:27.494431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:27.495949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c763bc-9180-4acf-8b9e-3e76208cfbdb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:27.516060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 666/1326] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:29.892612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a589f-42a1-415d-8039-6ae991238a20 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:29.893210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a589f-42a1-415d-8039-6ae991238a20 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:29.893210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a589f-42a1-415d-8039-6ae991238a20 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:29.894516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 661/1327] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:29.899746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ecbad-c053-42c9-9b2e-872e29656a50 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:29.900214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ecbad-c053-42c9-9b2e-872e29656a50 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:29.900307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ecbad-c053-42c9-9b2e-872e29656a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:29.968215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-356ecbad-c053-42c9-9b2e-872e29656a50 None None] MFA Rules not processed for user `75faa1ace44b41f89a9a5c74487a0819`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:29.969486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-356ecbad-c053-42c9-9b2e-872e29656a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:30.045927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:30.090426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 667/1328] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:30.147463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2748-3007-4cde-90f8-bf59a7142416 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:30.147666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2748-3007-4cde-90f8-bf59a7142416 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:30.147971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2748-3007-4cde-90f8-bf59a7142416 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:30.149336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 662/1329] 10.222.0.61 () {54 vars in 964 bytes} [Fri Jun 3 08:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:30.155488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49890b-50e2-4d2c-a957-1f8702838c8f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:30.155817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49890b-50e2-4d2c-a957-1f8702838c8f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:30.156097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49890b-50e2-4d2c-a957-1f8702838c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:30.231582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dd49890b-50e2-4d2c-a957-1f8702838c8f None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:30.232814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dd49890b-50e2-4d2c-a957-1f8702838c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:30.315017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 668/1330] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Jun 3 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:30.324511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2748-3007-4cde-90f8-bf59a7142416 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:30.326026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-90ad2748-3007-4cde-90f8-bf59a7142416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:30.358344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:30.433388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2748-3007-4cde-90f8-bf59a7142416 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:30.511654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:30.512596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:30.512941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:30.513223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:30.514914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:30.595728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:30.628785 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:30.630250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face5a36-2290-4a56-bad5-78e6d123f6e2 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:30.648578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 663/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:33.596557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781173a-81d9-4bcb-9942-077311613a17 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:33.597125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781173a-81d9-4bcb-9942-077311613a17 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:33.597125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781173a-81d9-4bcb-9942-077311613a17 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:33.598496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 669/1332] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:33.603881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355785b2-ce3f-4dd0-a8f9-2755916a2b1f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:33.604347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355785b2-ce3f-4dd0-a8f9-2755916a2b1f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:33.604549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355785b2-ce3f-4dd0-a8f9-2755916a2b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:33.678683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-355785b2-ce3f-4dd0-a8f9-2755916a2b1f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:33.679938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-355785b2-ce3f-4dd0-a8f9-2755916a2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:33.798357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 664/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:33.835703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781173a-81d9-4bcb-9942-077311613a17 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:33.837282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2781173a-81d9-4bcb-9942-077311613a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:33.917807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:33.956747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781173a-81d9-4bcb-9942-077311613a17 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:34.049534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:34.050591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:34.051085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:34.051596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:34.054969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:34.200642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:34.202013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5c0ae-584e-4688-be31-838231f05d16 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:34.213237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:34.223004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 670/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:36.665407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316d38-2424-4f95-a692-51d552f6d4db None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:36.665945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316d38-2424-4f95-a692-51d552f6d4db None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:36.665945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316d38-2424-4f95-a692-51d552f6d4db None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:36.667240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 665/1335] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:36.673646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515da0f-8d7a-4e7d-81eb-870aa9066dba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:36.674150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515da0f-8d7a-4e7d-81eb-870aa9066dba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:36.674243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515da0f-8d7a-4e7d-81eb-870aa9066dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:36.741392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0515da0f-8d7a-4e7d-81eb-870aa9066dba None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:36.742615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0515da0f-8d7a-4e7d-81eb-870aa9066dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:36.852768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 671/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:36.893635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b316d38-2424-4f95-a692-51d552f6d4db None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:36.895189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0b316d38-2424-4f95-a692-51d552f6d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:36.937608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:37.005369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b316d38-2424-4f95-a692-51d552f6d4db None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:37.082512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:37.083172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:37.083452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:37.083725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:37.085479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:37.181479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:37.209947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:37.211335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8540e-62a1-448c-bcc8-7c0b345de607 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:37.231358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 666/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 08:56:40.057620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4989-20ab-4eba-95a4-eb64cd2d595d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:40.058194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4989-20ab-4eba-95a4-eb64cd2d595d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:40.058194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4989-20ab-4eba-95a4-eb64cd2d595d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:40.059541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 672/1338] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:40.065342 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae374f09-231c-450d-98ac-84dca2283efa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:40.065832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae374f09-231c-450d-98ac-84dca2283efa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:40.065957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae374f09-231c-450d-98ac-84dca2283efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:40.268924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ae374f09-231c-450d-98ac-84dca2283efa None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:40.270094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ae374f09-231c-450d-98ac-84dca2283efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:40.380598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 667/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:56:40.417363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a4989-20ab-4eba-95a4-eb64cd2d595d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:40.420830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8a0a4989-20ab-4eba-95a4-eb64cd2d595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:40.511382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:40.550163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a4989-20ab-4eba-95a4-eb64cd2d595d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:40.554354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:40.555000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:40.555278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:40.555551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:40.557365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:40.672740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:40.674215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396a807-5d31-42c4-be58-6590be64d58e service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:40.696238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 673/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:45.169963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea158e7-23eb-4d36-a3b1-208b7be405a7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:45.170589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea158e7-23eb-4d36-a3b1-208b7be405a7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:45.170589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea158e7-23eb-4d36-a3b1-208b7be405a7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:45.172737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 668/1341] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:45.179029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6fd3-72e7-4d5c-85cb-d03cff701073 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:45.179572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6fd3-72e7-4d5c-85cb-d03cff701073 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:45.179572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6fd3-72e7-4d5c-85cb-d03cff701073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:45.237006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-382d6fd3-72e7-4d5c-85cb-d03cff701073 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:45.239368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-382d6fd3-72e7-4d5c-85cb-d03cff701073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:45.357695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:56:45.401207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 674/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:45.475330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea158e7-23eb-4d36-a3b1-208b7be405a7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:45.494944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea158e7-23eb-4d36-a3b1-208b7be405a7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:45.500689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b0487-542d-49b4-8265-cdfdd66eeece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:45.501773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0487-542d-49b4-8265-cdfdd66eeece service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:45.502269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0487-542d-49b4-8265-cdfdd66eeece service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:45.502765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0487-542d-49b4-8265-cdfdd66eeece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:45.519601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b0487-542d-49b4-8265-cdfdd66eeece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:45.522936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b0487-542d-49b4-8265-cdfdd66eeece service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:45.542088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 669/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:48.736276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4a830-a161-4f09-9f26-cb4470fd70c9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:48.737099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4a830-a161-4f09-9f26-cb4470fd70c9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:48.737099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4a830-a161-4f09-9f26-cb4470fd70c9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:48.738595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 675/1344] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:48.746406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6fa34-27d7-4e97-aa02-ebd42a5f54c2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:48.747100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6fa34-27d7-4e97-aa02-ebd42a5f54c2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:48.747709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6fa34-27d7-4e97-aa02-ebd42a5f54c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:48.793194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0bf6fa34-27d7-4e97-aa02-ebd42a5f54c2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:48.794535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0bf6fa34-27d7-4e97-aa02-ebd42a5f54c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:48.807614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 670/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:56:48.847838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4a830-a161-4f09-9f26-cb4470fd70c9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:48.850021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d3c4a830-a161-4f09-9f26-cb4470fd70c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:48.866723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4a830-a161-4f09-9f26-cb4470fd70c9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:48.871164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50553-6f54-48ea-8275-4cff0502f246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:48.871889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50553-6f54-48ea-8275-4cff0502f246 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:48.872168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50553-6f54-48ea-8275-4cff0502f246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:48.872440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50553-6f54-48ea-8275-4cff0502f246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:48.884934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50553-6f54-48ea-8275-4cff0502f246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:48.886952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50553-6f54-48ea-8275-4cff0502f246 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:48.906302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 676/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:56:54.099233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890571-47f2-476b-9360-aac38825d80e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:54.099820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890571-47f2-476b-9360-aac38825d80e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:54.099820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890571-47f2-476b-9360-aac38825d80e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:54.101175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 671/1347] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:56:54.107070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b74ec-2430-4b72-ba83-76abc5b6de16 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:54.107584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b74ec-2430-4b72-ba83-76abc5b6de16 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:54.107720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b74ec-2430-4b72-ba83-76abc5b6de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:54.126763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e59b74ec-2430-4b72-ba83-76abc5b6de16 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:56:54.128017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e59b74ec-2430-4b72-ba83-76abc5b6de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:56:54.136166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 677/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:56:54.179146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890571-47f2-476b-9360-aac38825d80e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:56:54.190139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890571-47f2-476b-9360-aac38825d80e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:56:54.193674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eb783-2339-4f60-add0-d39594ca1946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:56:54.194346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb783-2339-4f60-add0-d39594ca1946 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:56:54.194648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb783-2339-4f60-add0-d39594ca1946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:56:54.194937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb783-2339-4f60-add0-d39594ca1946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:56:54.206003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eb783-2339-4f60-add0-d39594ca1946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:56:54.207890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eb783-2339-4f60-add0-d39594ca1946 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:56:54.218824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 672/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:00.089405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a2cb-f3a2-43e8-bd90-63ab1e43ed51 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:00.090735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a2cb-f3a2-43e8-bd90-63ab1e43ed51 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:00.091262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a2cb-f3a2-43e8-bd90-63ab1e43ed51 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:00.093170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 678/1350] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 08:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:00.099579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6bf12-3d43-4952-85e0-71cd3a9f8245 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:00.100810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6bf12-3d43-4952-85e0-71cd3a9f8245 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:00.101420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6bf12-3d43-4952-85e0-71cd3a9f8245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:00.111343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:00.210686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-94a6bf12-3d43-4952-85e0-71cd3a9f8245 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:00.210686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-94a6bf12-3d43-4952-85e0-71cd3a9f8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:00.350756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 673/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:04.122712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=15 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:05.097200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46680-6ed6-459e-8d80-1246636cce65 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:05.097590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46680-6ed6-459e-8d80-1246636cce65 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:05.097736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46680-6ed6-459e-8d80-1246636cce65 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:05.099335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 679/1352] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 08:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:05.104629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211662e-3f7e-44d7-8f87-96c29cfb8e4c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:05.105516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211662e-3f7e-44d7-8f87-96c29cfb8e4c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:05.106023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211662e-3f7e-44d7-8f87-96c29cfb8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:05.125874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e211662e-3f7e-44d7-8f87-96c29cfb8e4c None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:05.127079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e211662e-3f7e-44d7-8f87-96c29cfb8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:05.136110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 674/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:06.548831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717fca5-f2e5-46e5-86dc-08307afe5964 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:06.549352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717fca5-f2e5-46e5-86dc-08307afe5964 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:06.549352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717fca5-f2e5-46e5-86dc-08307afe5964 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:06.550819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 680/1354] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 08:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:06.556130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b3bd-af6e-4cd5-9ccd-ab3b8db48791 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:06.556654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b3bd-af6e-4cd5-9ccd-ab3b8db48791 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:06.556844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b3bd-af6e-4cd5-9ccd-ab3b8db48791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:06.575019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-abd8b3bd-af6e-4cd5-9ccd-ab3b8db48791 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:06.576407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-abd8b3bd-af6e-4cd5-9ccd-ab3b8db48791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:06.586065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 675/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 08:57:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:10.557048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfa3a-53c8-4df9-a79c-bb321b42034d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:10.557984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfa3a-53c8-4df9-a79c-bb321b42034d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:10.558251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfa3a-53c8-4df9-a79c-bb321b42034d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:10.560003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 681/1356] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:10.566378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239f0e-ac6e-4427-83c0-0bd63b844630 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:10.566953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239f0e-ac6e-4427-83c0-0bd63b844630 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:10.566953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239f0e-ac6e-4427-83c0-0bd63b844630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:10.587569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b7239f0e-ac6e-4427-83c0-0bd63b844630 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:10.588841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b7239f0e-ac6e-4427-83c0-0bd63b844630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:10.597425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 676/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:10.654164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4c6b-dcf9-4c12-8314-76792feecab4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:10.654453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4c6b-dcf9-4c12-8314-76792feecab4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:10.654730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4c6b-dcf9-4c12-8314-76792feecab4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:10.656296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 682/1358] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 08:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:10.666185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694efb-8dec-4765-ac83-d1de2b2f39bc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:10.666461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694efb-8dec-4765-ac83-d1de2b2f39bc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:10.666986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694efb-8dec-4765-ac83-d1de2b2f39bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:10.762315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d5694efb-8dec-4765-ac83-d1de2b2f39bc None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:10.764448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d5694efb-8dec-4765-ac83-d1de2b2f39bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:10.857174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:10.895282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 677/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:10.903405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4c6b-dcf9-4c12-8314-76792feecab4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:10.920098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4c6b-dcf9-4c12-8314-76792feecab4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:10.926195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787541a-e51b-4aa1-a08c-e5ba12419ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:10.926971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787541a-e51b-4aa1-a08c-e5ba12419ddf service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:10.927321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787541a-e51b-4aa1-a08c-e5ba12419ddf service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:10.927819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787541a-e51b-4aa1-a08c-e5ba12419ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:10.937227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787541a-e51b-4aa1-a08c-e5ba12419ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:10.938823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787541a-e51b-4aa1-a08c-e5ba12419ddf service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:10.949595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 683/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:13.453911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ca09-e974-4833-913f-2e05f8664097 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:13.454451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ca09-e974-4833-913f-2e05f8664097 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:13.454451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ca09-e974-4833-913f-2e05f8664097 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:13.455993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 678/1361] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:13.461284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecbd0a-c7db-47a1-9f3a-8fe7b9e7b4a6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:13.462100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecbd0a-c7db-47a1-9f3a-8fe7b9e7b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:13.462382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecbd0a-c7db-47a1-9f3a-8fe7b9e7b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:13.482347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b6ecbd0a-c7db-47a1-9f3a-8fe7b9e7b4a6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:13.483541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b6ecbd0a-c7db-47a1-9f3a-8fe7b9e7b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:13.494873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 684/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:13.540108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ca09-e974-4833-913f-2e05f8664097 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:13.557016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ca09-e974-4833-913f-2e05f8664097 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:13.562892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0b7d-e3e7-4c6d-8d85-3bc889536bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:13.563476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0b7d-e3e7-4c6d-8d85-3bc889536bc4 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:13.563776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0b7d-e3e7-4c6d-8d85-3bc889536bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:13.564051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0b7d-e3e7-4c6d-8d85-3bc889536bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:13.572945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0b7d-e3e7-4c6d-8d85-3bc889536bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:13.574535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0b7d-e3e7-4c6d-8d85-3bc889536bc4 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:13.585094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 679/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:16.182939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d24d-8e85-4a99-8c95-7f8a771a5945 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:16.183462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d24d-8e85-4a99-8c95-7f8a771a5945 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:16.183462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d24d-8e85-4a99-8c95-7f8a771a5945 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:16.184873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 685/1364] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:16.190278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f0dce-dcc6-4bf9-bd81-0494b50ee181 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:16.190706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f0dce-dcc6-4bf9-bd81-0494b50ee181 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:16.190822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f0dce-dcc6-4bf9-bd81-0494b50ee181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:16.209041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-da0f0dce-dcc6-4bf9-bd81-0494b50ee181 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:16.210237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-da0f0dce-dcc6-4bf9-bd81-0494b50ee181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:16.218100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 680/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:16.266750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed986fa-34ab-4970-b1c3-c3a665bbaf6f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:16.267062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed986fa-34ab-4970-b1c3-c3a665bbaf6f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:16.267371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed986fa-34ab-4970-b1c3-c3a665bbaf6f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:16.269003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 686/1366] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 08:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:16.274608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af516e-896d-4968-bb54-9bab6fd2f6c1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:16.274888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af516e-896d-4968-bb54-9bab6fd2f6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:16.275166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af516e-896d-4968-bb54-9bab6fd2f6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:16.294912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-82af516e-896d-4968-bb54-9bab6fd2f6c1 None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:16.296417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-82af516e-896d-4968-bb54-9bab6fd2f6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:16.314057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 681/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 08:57:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:16.322346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed986fa-34ab-4970-b1c3-c3a665bbaf6f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:16.336862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed986fa-34ab-4970-b1c3-c3a665bbaf6f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:16.342329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1abd1-26a0-4e0a-a44b-6b5635849b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:16.342974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1abd1-26a0-4e0a-a44b-6b5635849b6a service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:16.343251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1abd1-26a0-4e0a-a44b-6b5635849b6a service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:16.344064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1abd1-26a0-4e0a-a44b-6b5635849b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:16.352323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1abd1-26a0-4e0a-a44b-6b5635849b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:16.353921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1abd1-26a0-4e0a-a44b-6b5635849b6a service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:16.364049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 687/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:18.692664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6034-759a-4082-8b0d-8b6a4b19ecf0 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:18.693511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6034-759a-4082-8b0d-8b6a4b19ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:18.693953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6034-759a-4082-8b0d-8b6a4b19ecf0 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:18.701211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1ca9b-5857-438d-a70c-cb0d2693f387 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:18.702018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1ca9b-5857-438d-a70c-cb0d2693f387 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:18.702445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1ca9b-5857-438d-a70c-cb0d2693f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:18.705149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 682/1369] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:18.732444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fee1ca9b-5857-438d-a70c-cb0d2693f387 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:18.733651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fee1ca9b-5857-438d-a70c-cb0d2693f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:18.748526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 688/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:18.794812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6034-759a-4082-8b0d-8b6a4b19ecf0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:18.816426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6034-759a-4082-8b0d-8b6a4b19ecf0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:18.829611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7017c-fb73-45e9-bd85-8e4ad930411a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:18.831583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7017c-fb73-45e9-bd85-8e4ad930411a service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:18.831906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7017c-fb73-45e9-bd85-8e4ad930411a service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:18.832186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7017c-fb73-45e9-bd85-8e4ad930411a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:18.841660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7017c-fb73-45e9-bd85-8e4ad930411a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:18.844393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7017c-fb73-45e9-bd85-8e4ad930411a service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:18.857991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 683/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:18.993415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6812298-674b-42b4-bc66-2fcbc4ec1d15 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:18.993668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6812298-674b-42b4-bc66-2fcbc4ec1d15 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:18.994118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6812298-674b-42b4-bc66-2fcbc4ec1d15 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:18.995650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 689/1372] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:19.002211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f099c-b2ad-460e-b108-a7d76680aa84 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:19.002484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f099c-b2ad-460e-b108-a7d76680aa84 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:19.002763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f099c-b2ad-460e-b108-a7d76680aa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:19.023596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-083f099c-b2ad-460e-b108-a7d76680aa84 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:19.024894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-083f099c-b2ad-460e-b108-a7d76680aa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:19.034145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 684/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:19.345820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b788-a519-4276-b12c-5bac678278cd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:19.345820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b788-a519-4276-b12c-5bac678278cd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:19.345820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563b788-a519-4276-b12c-5bac678278cd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:19.347067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 690/1374] 10.222.0.61 () {54 vars in 963 bytes} [Fri Jun 3 08:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:19.351739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244b19d-4abe-4714-ab3b-d7f561a81c45 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:19.352060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244b19d-4abe-4714-ab3b-d7f561a81c45 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:19.352340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244b19d-4abe-4714-ab3b-d7f561a81c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:19.403115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d244b19d-4abe-4714-ab3b-d7f561a81c45 None None] MFA Rules not processed for user `c06192133f444b13933b7c4a1997e3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:19.404359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d244b19d-4abe-4714-ab3b-d7f561a81c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:19.471074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 685/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Fri Jun 3 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:19.479008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b788-a519-4276-b12c-5bac678278cd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:19.490865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563b788-a519-4276-b12c-5bac678278cd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:19.494651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcb3a-eb2a-4283-a9e7-6ef4e35dd729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:19.495367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcb3a-eb2a-4283-a9e7-6ef4e35dd729 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:19.495838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcb3a-eb2a-4283-a9e7-6ef4e35dd729 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:19.496132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcb3a-eb2a-4283-a9e7-6ef4e35dd729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:19.506885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcb3a-eb2a-4283-a9e7-6ef4e35dd729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:19.508805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcb3a-eb2a-4283-a9e7-6ef4e35dd729 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:19.522716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 691/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:21.200437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d478-1e8a-473b-a9a5-69f5a2a32a15 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:21.200975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d478-1e8a-473b-a9a5-69f5a2a32a15 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:21.200975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d478-1e8a-473b-a9a5-69f5a2a32a15 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:21.202493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 686/1377] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:21.208249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183d5b-cbee-40d7-ace3-60df6d971fbf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:21.208698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183d5b-cbee-40d7-ace3-60df6d971fbf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:21.208792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183d5b-cbee-40d7-ace3-60df6d971fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:21.227178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-66183d5b-cbee-40d7-ace3-60df6d971fbf None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:21.228403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-66183d5b-cbee-40d7-ace3-60df6d971fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:21.236935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 692/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:21.283738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d478-1e8a-473b-a9a5-69f5a2a32a15 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:21.298832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d478-1e8a-473b-a9a5-69f5a2a32a15 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:21.304720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a0354-080d-4baa-b30e-4126f312a30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:21.305392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a0354-080d-4baa-b30e-4126f312a30a service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:21.305671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a0354-080d-4baa-b30e-4126f312a30a service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:21.305945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a0354-080d-4baa-b30e-4126f312a30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:21.316483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a0354-080d-4baa-b30e-4126f312a30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:21.318126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a0354-080d-4baa-b30e-4126f312a30a service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:21.329556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 687/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:23.629199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17a50-6fbd-4489-87ce-2ed2731c19e0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:23.629646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17a50-6fbd-4489-87ce-2ed2731c19e0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:23.629744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17a50-6fbd-4489-87ce-2ed2731c19e0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:23.631303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 693/1380] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:23.636645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233fca-7a7c-41f2-a7e3-582f96ced44a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:23.637406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233fca-7a7c-41f2-a7e3-582f96ced44a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:23.637829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233fca-7a7c-41f2-a7e3-582f96ced44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:23.656243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ce233fca-7a7c-41f2-a7e3-582f96ced44a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:23.657423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ce233fca-7a7c-41f2-a7e3-582f96ced44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:23.669516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 688/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:23.713362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f17a50-6fbd-4489-87ce-2ed2731c19e0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:23.728477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f17a50-6fbd-4489-87ce-2ed2731c19e0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:23.734700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba76490-8f45-4cba-a221-8459417d3d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:23.735344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76490-8f45-4cba-a221-8459417d3d91 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:23.735622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76490-8f45-4cba-a221-8459417d3d91 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:23.735925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76490-8f45-4cba-a221-8459417d3d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:23.744689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76490-8f45-4cba-a221-8459417d3d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:23.746288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76490-8f45-4cba-a221-8459417d3d91 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:23.756394 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 694/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:26.075730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f0b46-a522-400f-8804-f03c6b884004 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:26.076759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f0b46-a522-400f-8804-f03c6b884004 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:26.077042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f0b46-a522-400f-8804-f03c6b884004 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:26.078887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 689/1383] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:26.085188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e1cb-2e2f-4a31-8e7d-3d231cc346e2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:26.085797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e1cb-2e2f-4a31-8e7d-3d231cc346e2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:26.085797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e1cb-2e2f-4a31-8e7d-3d231cc346e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:26.106630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8d71e1cb-2e2f-4a31-8e7d-3d231cc346e2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:26.107914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8d71e1cb-2e2f-4a31-8e7d-3d231cc346e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:26.117017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 695/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:26.158383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f0b46-a522-400f-8804-f03c6b884004 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:26.173918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f0b46-a522-400f-8804-f03c6b884004 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:26.179709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c571b-4bd8-43ad-bb3c-0c3a934163c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:26.180373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c571b-4bd8-43ad-bb3c-0c3a934163c9 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:26.180649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c571b-4bd8-43ad-bb3c-0c3a934163c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:26.180920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c571b-4bd8-43ad-bb3c-0c3a934163c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:26.189797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c571b-4bd8-43ad-bb3c-0c3a934163c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:26.191383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c571b-4bd8-43ad-bb3c-0c3a934163c9 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:26.207922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 690/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:28.769814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5770-b0e5-4843-ae14-5fb0c29ae6bf None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:28.770400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5770-b0e5-4843-ae14-5fb0c29ae6bf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:28.770674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5770-b0e5-4843-ae14-5fb0c29ae6bf None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:28.772460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 696/1386] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:28.782567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ac9d-76aa-4c87-9fd8-23bd552b42af None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:28.783292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ac9d-76aa-4c87-9fd8-23bd552b42af None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:28.783292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ac9d-76aa-4c87-9fd8-23bd552b42af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:28.804712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-33e0ac9d-76aa-4c87-9fd8-23bd552b42af None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:28.805923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-33e0ac9d-76aa-4c87-9fd8-23bd552b42af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:28.814301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 691/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:28.871322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5770-b0e5-4843-ae14-5fb0c29ae6bf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:28.887210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5770-b0e5-4843-ae14-5fb0c29ae6bf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:28.893479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317278ad-2257-43c3-9899-93d9ae5fb19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:28.894151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317278ad-2257-43c3-9899-93d9ae5fb19c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:28.894454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317278ad-2257-43c3-9899-93d9ae5fb19c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:28.894746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317278ad-2257-43c3-9899-93d9ae5fb19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:28.903742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317278ad-2257-43c3-9899-93d9ae5fb19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:28.905435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317278ad-2257-43c3-9899-93d9ae5fb19c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:28.915547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 697/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:31.588222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c78e69-660c-47fe-a4d5-8fea41cb4cb7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:31.588918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c78e69-660c-47fe-a4d5-8fea41cb4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:31.588918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c78e69-660c-47fe-a4d5-8fea41cb4cb7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:31.590132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 692/1389] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:57:31.595476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820acdcb-1e16-4650-b41e-1dbdd11ecbd2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:31.595950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820acdcb-1e16-4650-b41e-1dbdd11ecbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:31.596077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820acdcb-1e16-4650-b41e-1dbdd11ecbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:31.614910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-820acdcb-1e16-4650-b41e-1dbdd11ecbd2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:31.616227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-820acdcb-1e16-4650-b41e-1dbdd11ecbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:31.625215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 698/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:31.670825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c78e69-660c-47fe-a4d5-8fea41cb4cb7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:31.686293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c78e69-660c-47fe-a4d5-8fea41cb4cb7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:31.692170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936f8a9-21b6-40a8-96e8-5ba23d85a996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:31.692852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f8a9-21b6-40a8-96e8-5ba23d85a996 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:31.693136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f8a9-21b6-40a8-96e8-5ba23d85a996 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:31.693427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f8a9-21b6-40a8-96e8-5ba23d85a996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:31.702805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936f8a9-21b6-40a8-96e8-5ba23d85a996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:31.704503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936f8a9-21b6-40a8-96e8-5ba23d85a996 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:31.714244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 693/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:34.081114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb191-e66b-4708-82d2-a78ff50b6eec None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:34.081694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb191-e66b-4708-82d2-a78ff50b6eec None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:34.081694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb191-e66b-4708-82d2-a78ff50b6eec None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:34.083054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 699/1392] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:34.088590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7161-a8d6-4a1c-b849-e62bbe1896ee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:34.089053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7161-a8d6-4a1c-b849-e62bbe1896ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:34.089165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7161-a8d6-4a1c-b849-e62bbe1896ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:34.111300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f0bf7161-a8d6-4a1c-b849-e62bbe1896ee None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:34.112515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f0bf7161-a8d6-4a1c-b849-e62bbe1896ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:34.121764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 694/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:34.165679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbb191-e66b-4708-82d2-a78ff50b6eec None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:34.174378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=46 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:34.181846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbb191-e66b-4708-82d2-a78ff50b6eec None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:34.187684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d58304-c227-4399-83ed-cce28ffc2d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:34.188353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d58304-c227-4399-83ed-cce28ffc2d8f service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:34.188634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d58304-c227-4399-83ed-cce28ffc2d8f service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:34.188903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d58304-c227-4399-83ed-cce28ffc2d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:34.197423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d58304-c227-4399-83ed-cce28ffc2d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:34.199064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d58304-c227-4399-83ed-cce28ffc2d8f service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:34.209189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 700/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:35.446198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419272fd-56c4-4a9c-a74b-b0e69c02d700 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:35.446808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419272fd-56c4-4a9c-a74b-b0e69c02d700 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:35.446808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419272fd-56c4-4a9c-a74b-b0e69c02d700 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:35.448162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 695/1395] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:35.453447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078424-b51e-4c32-bbac-8e9ad82df3c5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:35.453903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078424-b51e-4c32-bbac-8e9ad82df3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:35.454022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078424-b51e-4c32-bbac-8e9ad82df3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:35.471868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-55078424-b51e-4c32-bbac-8e9ad82df3c5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:35.473072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-55078424-b51e-4c32-bbac-8e9ad82df3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:35.481261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 701/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:35.536989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567987-b870-4d56-aca9-678455b2767d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:35.537278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567987-b870-4d56-aca9-678455b2767d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:35.537561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567987-b870-4d56-aca9-678455b2767d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:35.538945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 696/1397] 10.222.0.61 () {54 vars in 962 bytes} [Fri Jun 3 08:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:35.544004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8db1e-d5a8-4101-8f75-22810859e1b7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:35.544373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8db1e-d5a8-4101-8f75-22810859e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:35.544741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8db1e-d5a8-4101-8f75-22810859e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:35.594318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d0e8db1e-d5a8-4101-8f75-22810859e1b7 None None] MFA Rules not processed for user `12f623ab113a43b791f0180286fa5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:35.595503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d0e8db1e-d5a8-4101-8f75-22810859e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:35.656511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 702/1398] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Jun 3 08:57:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:35.664468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567987-b870-4d56-aca9-678455b2767d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:35.676182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567987-b870-4d56-aca9-678455b2767d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:35.679773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793562c0-b032-43d9-b72c-3c7251cb27c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:35.680413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793562c0-b032-43d9-b72c-3c7251cb27c6 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:35.680696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793562c0-b032-43d9-b72c-3c7251cb27c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:35.680974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793562c0-b032-43d9-b72c-3c7251cb27c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:35.690108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793562c0-b032-43d9-b72c-3c7251cb27c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:35.691549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793562c0-b032-43d9-b72c-3c7251cb27c6 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:35.695654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:35.702832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 697/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:36.238381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118cd25-20bd-4fb7-8e00-07d115e4a708 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.238696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118cd25-20bd-4fb7-8e00-07d115e4a708 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.239003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118cd25-20bd-4fb7-8e00-07d115e4a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.288090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3118cd25-20bd-4fb7-8e00-07d115e4a708 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:36.289293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3118cd25-20bd-4fb7-8e00-07d115e4a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:36.353848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 703/1400] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:57:36.395524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef3693-b652-4989-b7ba-49aeda4c5bf1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.395944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef3693-b652-4989-b7ba-49aeda4c5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.396321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef3693-b652-4989-b7ba-49aeda4c5bf1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.397772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 698/1401] 10.222.0.61 () {54 vars in 942 bytes} [Fri Jun 3 08:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:36.404182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.404555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.404900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.449885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:36.454154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] MFA Rules not processed for user `d8b00fb60e5e4548a5371831e56ad76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:36.455958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:36.520937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee2a51-4b3a-4e6d-9cf7-0db999e70e94 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.521482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee2a51-4b3a-4e6d-9cf7-0db999e70e94 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.521482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee2a51-4b3a-4e6d-9cf7-0db999e70e94 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.522756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 699/1402] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:57:36.527840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.528223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.528502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.530967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 704/1403] 10.222.0.61 () {58 vars in 1039 bytes} [Fri Jun 3 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:36.540239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:36.547612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:36.548845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:36.550218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83809f-9f69-4acc-be14-eb8dc6fe86bb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:36.556342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c7a0c-78df-4734-9e9c-074408622d6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:36.556717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 700/1404] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:36.557016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7a0c-78df-4734-9e9c-074408622d6c service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.557302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7a0c-78df-4734-9e9c-074408622d6c service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.557612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7a0c-78df-4734-9e9c-074408622d6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.566728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c7a0c-78df-4734-9e9c-074408622d6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:36.568361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c7a0c-78df-4734-9e9c-074408622d6c service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:36.576283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 705/1405] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 08:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 08:57:36.602392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:36.615208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edcb20-6d9e-4cce-8957-d5d512dee914 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:36.620808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529341c-346b-45cc-84e8-31b28cd92d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:36.621599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529341c-346b-45cc-84e8-31b28cd92d14 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:36.621883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529341c-346b-45cc-84e8-31b28cd92d14 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:36.622157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529341c-346b-45cc-84e8-31b28cd92d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:36.631874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529341c-346b-45cc-84e8-31b28cd92d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:36.633470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529341c-346b-45cc-84e8-31b28cd92d14 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:36.644811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 701/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:38.991658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65a12-ddc3-4fc2-b460-c48335a5df96 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:38.992158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65a12-ddc3-4fc2-b460-c48335a5df96 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:38.992272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65a12-ddc3-4fc2-b460-c48335a5df96 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:38.993624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 706/1407] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:57:38.998961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2e49-d8ed-4e95-a6aa-64f3824b5280 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:39.000081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2e49-d8ed-4e95-a6aa-64f3824b5280 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:39.000295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2e49-d8ed-4e95-a6aa-64f3824b5280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:39.019874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-847f2e49-d8ed-4e95-a6aa-64f3824b5280 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:57:39.021145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-847f2e49-d8ed-4e95-a6aa-64f3824b5280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:57:39.029673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 702/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:57:39.074769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65a12-ddc3-4fc2-b460-c48335a5df96 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:57:39.089347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65a12-ddc3-4fc2-b460-c48335a5df96 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:57:39.095049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b5798-bd15-4dae-b002-d3274685fd42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:57:39.097603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b5798-bd15-4dae-b002-d3274685fd42 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:57:39.098081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b5798-bd15-4dae-b002-d3274685fd42 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:57:39.098360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b5798-bd15-4dae-b002-d3274685fd42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:57:39.107201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b5798-bd15-4dae-b002-d3274685fd42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:57:39.109337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b5798-bd15-4dae-b002-d3274685fd42 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:57:39.132468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 707/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:57:49.154163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=13 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:57:49.155044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=42 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:58:00.308779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3966b0-07e6-478c-87e9-b12dfdbb5a3c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:00.309323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3966b0-07e6-478c-87e9-b12dfdbb5a3c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:00.309323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3966b0-07e6-478c-87e9-b12dfdbb5a3c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:00.310671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 703/1410] 10.222.0.61 () {54 vars in 918 bytes} [Fri Jun 3 08:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:00.316267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5daf11-e1ee-423d-9937-dcb3b1832b94 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:00.316734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5daf11-e1ee-423d-9937-dcb3b1832b94 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:00.316841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5daf11-e1ee-423d-9937-dcb3b1832b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:00.335194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8b5daf11-e1ee-423d-9937-dcb3b1832b94 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:00.336419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8b5daf11-e1ee-423d-9937-dcb3b1832b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:00.344828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 708/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Jun 3 08:58:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:00.358881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b8bb0-4f64-4cc0-a64c-6e85b2022e8b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:00.359165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b8bb0-4f64-4cc0-a64c-6e85b2022e8b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:00.359435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b8bb0-4f64-4cc0-a64c-6e85b2022e8b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:00.360806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 704/1412] 10.222.0.61 () {54 vars in 918 bytes} [Fri Jun 3 08:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:00.365456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac81546-9df6-49dd-af92-66ebee190ad0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:00.365736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac81546-9df6-49dd-af92-66ebee190ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:00.366004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac81546-9df6-49dd-af92-66ebee190ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:00.384092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dac81546-9df6-49dd-af92-66ebee190ad0 None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:00.385286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dac81546-9df6-49dd-af92-66ebee190ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:00.394971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 709/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Jun 3 08:58:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:58:03.140700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704dc21-fb6b-4291-84e7-222e27e1dbc9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:03.141262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704dc21-fb6b-4291-84e7-222e27e1dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:03.141262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704dc21-fb6b-4291-84e7-222e27e1dbc9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:03.142599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:03.147871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c61a8-90a3-4dc3-85d1-250b1fa97a08 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:03.148311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c61a8-90a3-4dc3-85d1-250b1fa97a08 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:03.148462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c61a8-90a3-4dc3-85d1-250b1fa97a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:03.166024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e98c61a8-90a3-4dc3-85d1-250b1fa97a08 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:03.167220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e98c61a8-90a3-4dc3-85d1-250b1fa97a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:03.175842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:03.218736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704dc21-fb6b-4291-84e7-222e27e1dbc9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:03.233526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704dc21-fb6b-4291-84e7-222e27e1dbc9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:03.239031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138dec4-b1f5-4a54-99b8-d29b957c4c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:03.239684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138dec4-b1f5-4a54-99b8-d29b957c4c72 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:03.239988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138dec4-b1f5-4a54-99b8-d29b957c4c72 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:03.240320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138dec4-b1f5-4a54-99b8-d29b957c4c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:03.249323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138dec4-b1f5-4a54-99b8-d29b957c4c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:03.250932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138dec4-b1f5-4a54-99b8-d29b957c4c72 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:03.260383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 706/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:04.227044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b76b-964f-407d-91b6-f19d0d9925b4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:04.227611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b76b-964f-407d-91b6-f19d0d9925b4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:04.227611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b76b-964f-407d-91b6-f19d0d9925b4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:04.229008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:04.234144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366967a-29d0-4d6b-9318-a5661be7e0d1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:04.234586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366967a-29d0-4d6b-9318-a5661be7e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:04.234689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366967a-29d0-4d6b-9318-a5661be7e0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:04.253248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5366967a-29d0-4d6b-9318-a5661be7e0d1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:04.254378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5366967a-29d0-4d6b-9318-a5661be7e0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:04.262293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:04.417570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b76b-964f-407d-91b6-f19d0d9925b4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:04.432239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b76b-964f-407d-91b6-f19d0d9925b4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:04.437930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2426bc-b933-4dbf-bdf2-98757e7d98f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:04.438557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2426bc-b933-4dbf-bdf2-98757e7d98f9 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:04.438835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2426bc-b933-4dbf-bdf2-98757e7d98f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:04.439103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2426bc-b933-4dbf-bdf2-98757e7d98f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:04.447038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2426bc-b933-4dbf-bdf2-98757e7d98f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:04.448656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2426bc-b933-4dbf-bdf2-98757e7d98f9 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:04.458773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 712/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:05.385263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad608b-5f79-47fe-83ba-0877d20c87f6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:05.385855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad608b-5f79-47fe-83ba-0877d20c87f6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:05.385855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad608b-5f79-47fe-83ba-0877d20c87f6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:05.387149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:05.395999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde8fc-ee27-47b9-a294-2cea9693d528 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:05.397081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde8fc-ee27-47b9-a294-2cea9693d528 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:05.397370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde8fc-ee27-47b9-a294-2cea9693d528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:05.416732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-64fde8fc-ee27-47b9-a294-2cea9693d528 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:05.417946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-64fde8fc-ee27-47b9-a294-2cea9693d528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:05.426026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:05.576570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad608b-5f79-47fe-83ba-0877d20c87f6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:05.591135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad608b-5f79-47fe-83ba-0877d20c87f6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:05.596475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc88f4-82a0-486f-b3f4-7ca40ff652ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:05.597107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc88f4-82a0-486f-b3f4-7ca40ff652ba service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:05.597384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc88f4-82a0-486f-b3f4-7ca40ff652ba service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:05.597655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc88f4-82a0-486f-b3f4-7ca40ff652ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:05.605646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc88f4-82a0-486f-b3f4-7ca40ff652ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:05.607229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc88f4-82a0-486f-b3f4-7ca40ff652ba service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:05.616629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 709/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:06.533724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ba00-9499-48a2-ab78-54ac249edd19 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:06.534285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ba00-9499-48a2-ab78-54ac249edd19 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:06.534285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ba00-9499-48a2-ab78-54ac249edd19 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:06.535638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:06.540990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b31d-1699-420d-8284-91776066d30d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:06.541420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b31d-1699-420d-8284-91776066d30d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:06.541635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b31d-1699-420d-8284-91776066d30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:06.561428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3e91b31d-1699-420d-8284-91776066d30d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:06.562635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3e91b31d-1699-420d-8284-91776066d30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:06.570691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:06.719696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ba00-9499-48a2-ab78-54ac249edd19 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:06.734409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ba00-9499-48a2-ab78-54ac249edd19 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:06.740793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51609-cfed-4a46-a41b-9b699fbf7921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:06.741461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51609-cfed-4a46-a41b-9b699fbf7921 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:06.741742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51609-cfed-4a46-a41b-9b699fbf7921 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:06.742011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51609-cfed-4a46-a41b-9b699fbf7921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:06.751464 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51609-cfed-4a46-a41b-9b699fbf7921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:06.753044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec51609-cfed-4a46-a41b-9b699fbf7921 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:06.763383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 715/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:07.662899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d841-13d1-4b3b-8f71-9738aa8a16fb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:07.663473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d841-13d1-4b3b-8f71-9738aa8a16fb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:07.663473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d841-13d1-4b3b-8f71-9738aa8a16fb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:07.664876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:07.669951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc07ca-5936-455e-b48a-ae77aa88bd45 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:07.670397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc07ca-5936-455e-b48a-ae77aa88bd45 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:07.670517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc07ca-5936-455e-b48a-ae77aa88bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:07.688453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-39cc07ca-5936-455e-b48a-ae77aa88bd45 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:07.689649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-39cc07ca-5936-455e-b48a-ae77aa88bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:07.697496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:07.848682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d841-13d1-4b3b-8f71-9738aa8a16fb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:07.863222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d841-13d1-4b3b-8f71-9738aa8a16fb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:07.868666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf8f2f-76da-47b9-99df-b552aaebee62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:07.869307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8f2f-76da-47b9-99df-b552aaebee62 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:07.869588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8f2f-76da-47b9-99df-b552aaebee62 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:07.869861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8f2f-76da-47b9-99df-b552aaebee62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:07.878636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf8f2f-76da-47b9-99df-b552aaebee62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:07.880284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf8f2f-76da-47b9-99df-b552aaebee62 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:07.890481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 712/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:08.749129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5bc34-5027-42fc-8e71-f2e73737a281 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:08.749662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5bc34-5027-42fc-8e71-f2e73737a281 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:08.749662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5bc34-5027-42fc-8e71-f2e73737a281 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:08.750971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:08.756029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250c16-b4c8-4352-829a-bcbbe0c8d3bd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:08.756441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250c16-b4c8-4352-829a-bcbbe0c8d3bd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:08.756582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250c16-b4c8-4352-829a-bcbbe0c8d3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:08.774086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-be250c16-b4c8-4352-829a-bcbbe0c8d3bd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:08.775285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-be250c16-b4c8-4352-829a-bcbbe0c8d3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:08.783603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:08.939094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5bc34-5027-42fc-8e71-f2e73737a281 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:08.954879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5bc34-5027-42fc-8e71-f2e73737a281 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:08.961027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852182-b67a-48ae-9b38-724b738c0d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:08.961669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852182-b67a-48ae-9b38-724b738c0d8d service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:08.961986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852182-b67a-48ae-9b38-724b738c0d8d service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:08.962371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852182-b67a-48ae-9b38-724b738c0d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:08.971857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852182-b67a-48ae-9b38-724b738c0d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:08.973472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852182-b67a-48ae-9b38-724b738c0d8d service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:08.982987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 718/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:09.848839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b397-2b34-4192-bf1f-7890c431d3fc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:09.849376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b397-2b34-4192-bf1f-7890c431d3fc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:09.849376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b397-2b34-4192-bf1f-7890c431d3fc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:09.850670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:09.855739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517fd8-0c2f-4d4d-95dd-15a7740b5aa2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:09.856149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517fd8-0c2f-4d4d-95dd-15a7740b5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:09.856352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517fd8-0c2f-4d4d-95dd-15a7740b5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:09.876224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f4517fd8-0c2f-4d4d-95dd-15a7740b5aa2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:09.877430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f4517fd8-0c2f-4d4d-95dd-15a7740b5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:09.885500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:10.035107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b397-2b34-4192-bf1f-7890c431d3fc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:10.050405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b397-2b34-4192-bf1f-7890c431d3fc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:10.056032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0165d9-a2d0-4616-b0dd-d4a3838cb41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:10.056666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0165d9-a2d0-4616-b0dd-d4a3838cb41a service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:10.056951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0165d9-a2d0-4616-b0dd-d4a3838cb41a service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:10.057229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0165d9-a2d0-4616-b0dd-d4a3838cb41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:10.066186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0165d9-a2d0-4616-b0dd-d4a3838cb41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:10.067809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0165d9-a2d0-4616-b0dd-d4a3838cb41a service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:10.077161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 715/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:10.937276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1931-71fb-42e8-867e-7ead0b9b34a2 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:10.937888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1931-71fb-42e8-867e-7ead0b9b34a2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:10.937888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1931-71fb-42e8-867e-7ead0b9b34a2 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:10.939287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:10.944283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425e2bd-7cae-4779-904f-9c89866792ae None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:10.944678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425e2bd-7cae-4779-904f-9c89866792ae None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:10.944846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425e2bd-7cae-4779-904f-9c89866792ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:10.965721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b425e2bd-7cae-4779-904f-9c89866792ae None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:10.965721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b425e2bd-7cae-4779-904f-9c89866792ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:10.972661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:11.127194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1931-71fb-42e8-867e-7ead0b9b34a2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:11.141903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1931-71fb-42e8-867e-7ead0b9b34a2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:11.147447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cd78f-5470-4332-8f61-aea290938e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:11.148105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cd78f-5470-4332-8f61-aea290938e91 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:11.148458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cd78f-5470-4332-8f61-aea290938e91 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:11.148760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cd78f-5470-4332-8f61-aea290938e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:11.158423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cd78f-5470-4332-8f61-aea290938e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:11.160451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cd78f-5470-4332-8f61-aea290938e91 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:11.170191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 721/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:12.016891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55e25-8b9d-4695-baaa-8099b19c5e12 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:12.017395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55e25-8b9d-4695-baaa-8099b19c5e12 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:12.017516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55e25-8b9d-4695-baaa-8099b19c5e12 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:12.018849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 08:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:12.023972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45acee-515e-40fd-8d60-254e5210f965 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:12.024415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45acee-515e-40fd-8d60-254e5210f965 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:12.024557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45acee-515e-40fd-8d60-254e5210f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:12.042294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8d45acee-515e-40fd-8d60-254e5210f965 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:12.043494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8d45acee-515e-40fd-8d60-254e5210f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:12.052105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 08:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:12.200781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55e25-8b9d-4695-baaa-8099b19c5e12 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:12.216709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55e25-8b9d-4695-baaa-8099b19c5e12 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:12.222117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf437e-7d22-46b4-bb92-2fe374c509de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:12.222763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf437e-7d22-46b4-bb92-2fe374c509de service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:12.223046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf437e-7d22-46b4-bb92-2fe374c509de service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:12.223322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf437e-7d22-46b4-bb92-2fe374c509de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:12.231856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf437e-7d22-46b4-bb92-2fe374c509de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:12.233944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf437e-7d22-46b4-bb92-2fe374c509de service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:12.243661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 718/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:14.371869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77e992-2d50-42b1-8381-3b66c9d9988c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:14.372430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77e992-2d50-42b1-8381-3b66c9d9988c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:14.372616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77e992-2d50-42b1-8381-3b66c9d9988c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:14.374554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:14.380201 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554475-574d-4fd1-91df-91621047be7b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:14.380695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554475-574d-4fd1-91df-91621047be7b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:14.380780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554475-574d-4fd1-91df-91621047be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:14.398940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4f554475-574d-4fd1-91df-91621047be7b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:14.400186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4f554475-574d-4fd1-91df-91621047be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:14.408332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:14.448409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77e992-2d50-42b1-8381-3b66c9d9988c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:14.459775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77e992-2d50-42b1-8381-3b66c9d9988c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:14.463377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaf582-f43a-4b0b-b4ca-42b76a1a84de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:14.464059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaf582-f43a-4b0b-b4ca-42b76a1a84de service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:14.464341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaf582-f43a-4b0b-b4ca-42b76a1a84de service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:14.464617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaf582-f43a-4b0b-b4ca-42b76a1a84de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:14.474304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaf582-f43a-4b0b-b4ca-42b76a1a84de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:14.475798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaf582-f43a-4b0b-b4ca-42b76a1a84de service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:14.486848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 724/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:16.863453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9800d-650f-4efc-973f-5d43ef2c7f99 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:16.864030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9800d-650f-4efc-973f-5d43ef2c7f99 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:16.864152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9800d-650f-4efc-973f-5d43ef2c7f99 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:16.865517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:16.870675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaffac-9cb4-40db-a683-54d52fbc2168 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:16.871065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaffac-9cb4-40db-a683-54d52fbc2168 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:16.871222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaffac-9cb4-40db-a683-54d52fbc2168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:16.889687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7bfaffac-9cb4-40db-a683-54d52fbc2168 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:16.890869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7bfaffac-9cb4-40db-a683-54d52fbc2168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:16.898531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:16.935485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9800d-650f-4efc-973f-5d43ef2c7f99 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:16.946815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9800d-650f-4efc-973f-5d43ef2c7f99 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:16.950328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fae23-7e52-4151-8413-9347ce5f1b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:16.950963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fae23-7e52-4151-8413-9347ce5f1b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:16.951241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fae23-7e52-4151-8413-9347ce5f1b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:16.952143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fae23-7e52-4151-8413-9347ce5f1b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:16.961047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fae23-7e52-4151-8413-9347ce5f1b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:16.962487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fae23-7e52-4151-8413-9347ce5f1b25 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:16.972959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 721/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:19.544836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d86c-8645-4019-8435-6735474a7a4b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:19.545465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d86c-8645-4019-8435-6735474a7a4b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:19.545465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d86c-8645-4019-8435-6735474a7a4b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:19.547030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:19.552535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c7aa0-216a-43b7-aed7-3dd5979b7062 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:19.552938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c7aa0-216a-43b7-aed7-3dd5979b7062 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:19.553077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c7aa0-216a-43b7-aed7-3dd5979b7062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:19.570743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d70c7aa0-216a-43b7-aed7-3dd5979b7062 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:19.571985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d70c7aa0-216a-43b7-aed7-3dd5979b7062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:19.580244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:19.619157 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5d86c-8645-4019-8435-6735474a7a4b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:19.630447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5d86c-8645-4019-8435-6735474a7a4b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:19.633947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2e7ac-f059-44ec-94db-6be64fdb7e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:19.634580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e7ac-f059-44ec-94db-6be64fdb7e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:19.634862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e7ac-f059-44ec-94db-6be64fdb7e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:19.635137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2e7ac-f059-44ec-94db-6be64fdb7e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:19.643971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2e7ac-f059-44ec-94db-6be64fdb7e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:19.645403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2e7ac-f059-44ec-94db-6be64fdb7e6a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:19.654869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 727/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:22.103171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173d15b-b111-478d-9675-aa508238ea94 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:22.103799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173d15b-b111-478d-9675-aa508238ea94 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:22.103799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173d15b-b111-478d-9675-aa508238ea94 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:22.105127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:22.111221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994b76-5181-43b7-8511-7bf7c6cb0b53 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:22.111722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994b76-5181-43b7-8511-7bf7c6cb0b53 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:22.111853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994b76-5181-43b7-8511-7bf7c6cb0b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:22.129654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e7994b76-5181-43b7-8511-7bf7c6cb0b53 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:22.130855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e7994b76-5181-43b7-8511-7bf7c6cb0b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:22.142693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:22.181821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173d15b-b111-478d-9675-aa508238ea94 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:22.192578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173d15b-b111-478d-9675-aa508238ea94 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:22.196362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327406f-c4c3-45a6-a93a-f6d66904e5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:22.197004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327406f-c4c3-45a6-a93a-f6d66904e5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:22.197191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327406f-c4c3-45a6-a93a-f6d66904e5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:22.197440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327406f-c4c3-45a6-a93a-f6d66904e5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:22.206879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327406f-c4c3-45a6-a93a-f6d66904e5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:22.208349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327406f-c4c3-45a6-a93a-f6d66904e5e2 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:22.218171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 724/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 08:58:24.513705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842e811-7941-4569-8fe5-fe1c715a1c31 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:24.514190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842e811-7941-4569-8fe5-fe1c715a1c31 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:24.514295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842e811-7941-4569-8fe5-fe1c715a1c31 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:24.515635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:24.521143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbea2d-2425-4354-85dc-a0133677fcb8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:24.521569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbea2d-2425-4354-85dc-a0133677fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:24.521677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbea2d-2425-4354-85dc-a0133677fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:24.540401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a9dbea2d-2425-4354-85dc-a0133677fcb8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:24.541616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a9dbea2d-2425-4354-85dc-a0133677fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:24.550584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:24.588932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842e811-7941-4569-8fe5-fe1c715a1c31 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:24.600217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842e811-7941-4569-8fe5-fe1c715a1c31 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:24.603845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07a1fb-f7ed-47b3-861a-4cb449cae4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:24.604481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a1fb-f7ed-47b3-861a-4cb449cae4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:24.604767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a1fb-f7ed-47b3-861a-4cb449cae4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:24.605038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a1fb-f7ed-47b3-861a-4cb449cae4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:24.614603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07a1fb-f7ed-47b3-861a-4cb449cae4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:24.616076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07a1fb-f7ed-47b3-861a-4cb449cae4f3 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:24.625348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 730/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:26.933238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee206-97e3-40d0-a40f-59a3e9b4955f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:26.933812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee206-97e3-40d0-a40f-59a3e9b4955f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:26.933812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee206-97e3-40d0-a40f-59a3e9b4955f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:26.935146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:26.940540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df0ab3-040d-488a-95f6-96d85ea9d8ef None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:26.940993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df0ab3-040d-488a-95f6-96d85ea9d8ef None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:26.941293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df0ab3-040d-488a-95f6-96d85ea9d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:26.959274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-22df0ab3-040d-488a-95f6-96d85ea9d8ef None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:26.960511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-22df0ab3-040d-488a-95f6-96d85ea9d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:26.969017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:27.007046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee206-97e3-40d0-a40f-59a3e9b4955f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:27.018089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee206-97e3-40d0-a40f-59a3e9b4955f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:27.021588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ab850-39c3-49f0-bdbc-922677dc9466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:27.022214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab850-39c3-49f0-bdbc-922677dc9466 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:27.022552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab850-39c3-49f0-bdbc-922677dc9466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:27.022761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab850-39c3-49f0-bdbc-922677dc9466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:27.032170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ab850-39c3-49f0-bdbc-922677dc9466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:27.033607 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ab850-39c3-49f0-bdbc-922677dc9466 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:27.042781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 727/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:29.376946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b2ca-e1bf-45b5-abc9-66dde0d24439 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:29.377515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b2ca-e1bf-45b5-abc9-66dde0d24439 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:29.377515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b2ca-e1bf-45b5-abc9-66dde0d24439 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:29.378927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:29.384350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801267f-4f97-44a2-b36e-a9444524a519 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:29.384801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801267f-4f97-44a2-b36e-a9444524a519 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:29.384971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801267f-4f97-44a2-b36e-a9444524a519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:29.391156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=70 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:58:29.403660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2801267f-4f97-44a2-b36e-a9444524a519 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:29.404921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2801267f-4f97-44a2-b36e-a9444524a519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:29.412913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:29.451118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394b2ca-e1bf-45b5-abc9-66dde0d24439 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:29.456537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=73 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:58:29.463094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394b2ca-e1bf-45b5-abc9-66dde0d24439 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:29.466604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93bcfd-bcf0-4bd2-bb1c-58185a02bd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:29.467246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93bcfd-bcf0-4bd2-bb1c-58185a02bd8e service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:29.467558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93bcfd-bcf0-4bd2-bb1c-58185a02bd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:29.467864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93bcfd-bcf0-4bd2-bb1c-58185a02bd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:29.476746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93bcfd-bcf0-4bd2-bb1c-58185a02bd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:29.478225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93bcfd-bcf0-4bd2-bb1c-58185a02bd8e service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:29.488089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 733/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:31.867713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083d57-bac4-4455-b4d4-d6d70c8e870f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:31.868344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083d57-bac4-4455-b4d4-d6d70c8e870f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:31.868344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083d57-bac4-4455-b4d4-d6d70c8e870f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:31.869696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:31.875309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beb41e-5931-4afc-b754-331721d09269 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:31.875736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beb41e-5931-4afc-b754-331721d09269 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:31.875887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beb41e-5931-4afc-b754-331721d09269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:31.893460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-81beb41e-5931-4afc-b754-331721d09269 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:31.894660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-81beb41e-5931-4afc-b754-331721d09269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:31.902458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:31.940636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083d57-bac4-4455-b4d4-d6d70c8e870f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:31.951938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083d57-bac4-4455-b4d4-d6d70c8e870f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:31.955477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583fd3-ac34-4f5a-b3ed-73ba06ea3cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:31.956163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583fd3-ac34-4f5a-b3ed-73ba06ea3cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:31.956448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583fd3-ac34-4f5a-b3ed-73ba06ea3cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:31.956726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583fd3-ac34-4f5a-b3ed-73ba06ea3cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:31.966088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583fd3-ac34-4f5a-b3ed-73ba06ea3cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:31.968054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583fd3-ac34-4f5a-b3ed-73ba06ea3cc4 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:31.977705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 730/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:34.224688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fd07a-0e84-40fa-9f96-1895e0ca44eb None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:34.225256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fd07a-0e84-40fa-9f96-1895e0ca44eb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:34.225256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fd07a-0e84-40fa-9f96-1895e0ca44eb None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:34.226628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:34.231832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee092-788c-4ad6-882f-b41084a98652 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:34.232314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee092-788c-4ad6-882f-b41084a98652 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:34.232476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee092-788c-4ad6-882f-b41084a98652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:34.250911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d72ee092-788c-4ad6-882f-b41084a98652 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:34.252079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d72ee092-788c-4ad6-882f-b41084a98652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:34.259977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:34.297863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fd07a-0e84-40fa-9f96-1895e0ca44eb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:34.308919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fd07a-0e84-40fa-9f96-1895e0ca44eb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:34.313068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79f021-3837-475f-92f8-83cbdbc5f0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:34.313711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f021-3837-475f-92f8-83cbdbc5f0ef service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:34.313996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f021-3837-475f-92f8-83cbdbc5f0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:34.314274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79f021-3837-475f-92f8-83cbdbc5f0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:34.323247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79f021-3837-475f-92f8-83cbdbc5f0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:34.324717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79f021-3837-475f-92f8-83cbdbc5f0ef service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:34.334597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 736/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:36.582826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b7994-9bdb-47a4-96bc-be25535e99aa None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:36.583667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b7994-9bdb-47a4-96bc-be25535e99aa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:36.583878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b7994-9bdb-47a4-96bc-be25535e99aa None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:36.585368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 08:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:58:36.590618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3de0c-ad4b-4f06-826b-ff6e02c53e61 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:36.591042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3de0c-ad4b-4f06-826b-ff6e02c53e61 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:36.591161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3de0c-ad4b-4f06-826b-ff6e02c53e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:36.608609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c8c3de0c-ad4b-4f06-826b-ff6e02c53e61 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:58:36.609785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c8c3de0c-ad4b-4f06-826b-ff6e02c53e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:58:36.617369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 08:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:58:36.653658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b7994-9bdb-47a4-96bc-be25535e99aa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:58:36.664395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b7994-9bdb-47a4-96bc-be25535e99aa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:58:36.668115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097850e3-a356-4686-ba08-599673bb7b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:58:36.668749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097850e3-a356-4686-ba08-599673bb7b34 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:58:36.669027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097850e3-a356-4686-ba08-599673bb7b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:58:36.669294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097850e3-a356-4686-ba08-599673bb7b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:58:36.678739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097850e3-a356-4686-ba08-599673bb7b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:58:36.680231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097850e3-a356-4686-ba08-599673bb7b34 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:58:36.689879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 733/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:58:46.603517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=17 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:58:46.685317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=17 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:59:08.583154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188f7e-e571-4647-98fb-4329cf2428d8 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:08.583780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188f7e-e571-4647-98fb-4329cf2428d8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:08.583780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188f7e-e571-4647-98fb-4329cf2428d8 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:08.585146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 738/1471] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:59:08.590301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb384-bc11-4326-bcf8-a0ccfeef0731 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:08.590800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb384-bc11-4326-bcf8-a0ccfeef0731 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:08.590907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb384-bc11-4326-bcf8-a0ccfeef0731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:08.608311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-daeeb384-bc11-4326-bcf8-a0ccfeef0731 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:08.609514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-daeeb384-bc11-4326-bcf8-a0ccfeef0731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:08.617301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 734/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:08.665583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f1b12-6853-4326-8b00-b92453481215 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:08.665876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f1b12-6853-4326-8b00-b92453481215 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:08.666158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f1b12-6853-4326-8b00-b92453481215 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:08.667529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 739/1473] 10.222.0.61 () {54 vars in 962 bytes} [Fri Jun 3 08:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:59:08.672647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d279a9c-aeb4-46ef-9428-d7b539873c42 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:08.672944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d279a9c-aeb4-46ef-9428-d7b539873c42 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:08.673315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d279a9c-aeb4-46ef-9428-d7b539873c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:08.691476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7d279a9c-aeb4-46ef-9428-d7b539873c42 None None] MFA Rules not processed for user `12f623ab113a43b791f0180286fa5ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:08.692713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7d279a9c-aeb4-46ef-9428-d7b539873c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:08.699180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 735/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Jun 3 08:59:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:08.706867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f1b12-6853-4326-8b00-b92453481215 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:08.717410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f1b12-6853-4326-8b00-b92453481215 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:08.721049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86c66d-7c8e-4a1f-a3e8-28afd93ee36e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:08.721710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86c66d-7c8e-4a1f-a3e8-28afd93ee36e service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:08.721993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86c66d-7c8e-4a1f-a3e8-28afd93ee36e service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:08.722267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86c66d-7c8e-4a1f-a3e8-28afd93ee36e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:08.731508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86c66d-7c8e-4a1f-a3e8-28afd93ee36e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:08.732989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86c66d-7c8e-4a1f-a3e8-28afd93ee36e service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:08.742635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 740/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 08:59:11.067929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec029-b88a-46f1-8ba6-b4fab12240ef None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:11.068492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec029-b88a-46f1-8ba6-b4fab12240ef None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:11.068492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eec029-b88a-46f1-8ba6-b4fab12240ef None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:11.069917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 736/1476] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:59:11.075295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5025e-1ccb-4391-98f6-9192e9c7081b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:11.075732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5025e-1ccb-4391-98f6-9192e9c7081b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:11.075904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5025e-1ccb-4391-98f6-9192e9c7081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:11.093979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-15d5025e-1ccb-4391-98f6-9192e9c7081b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:11.095116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-15d5025e-1ccb-4391-98f6-9192e9c7081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:11.102962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 741/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:11.127207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec029-b88a-46f1-8ba6-b4fab12240ef None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:11.139700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eec029-b88a-46f1-8ba6-b4fab12240ef None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:11.144186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:11.144829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:11.145113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:11.145385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:11.146099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:11.147873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 08:59:11.147873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 08:59:11.147873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 08:59:11.149029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7739b-0479-4f62-969c-a6a7935783c4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:11.169524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 737/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 08:59:11 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 08:59:13.449668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb80c9-8a23-4790-b64b-4d8e35705cfa None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:13.450847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb80c9-8a23-4790-b64b-4d8e35705cfa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:13.450847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb80c9-8a23-4790-b64b-4d8e35705cfa None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:13.452220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 742/1479] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:59:13.457377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e1e71-d886-427f-bc10-a0ede005e3ad None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:13.457838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e1e71-d886-427f-bc10-a0ede005e3ad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:13.457954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e1e71-d886-427f-bc10-a0ede005e3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:13.475543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-972e1e71-d886-427f-bc10-a0ede005e3ad None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:13.476778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-972e1e71-d886-427f-bc10-a0ede005e3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:13.484925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 738/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:13.527567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb80c9-8a23-4790-b64b-4d8e35705cfa None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:13.542066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb80c9-8a23-4790-b64b-4d8e35705cfa None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:13.548263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c68a30-2e72-498d-9601-e299a15d562a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:13.548901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c68a30-2e72-498d-9601-e299a15d562a service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:13.549188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c68a30-2e72-498d-9601-e299a15d562a service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:13.549465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c68a30-2e72-498d-9601-e299a15d562a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:13.557767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c68a30-2e72-498d-9601-e299a15d562a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:13.560166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c68a30-2e72-498d-9601-e299a15d562a service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:13.569771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 743/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:59:15.997801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba94ab-a7da-49e5-a773-554f4b0d430a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:15.998335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba94ab-a7da-49e5-a773-554f4b0d430a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:15.998335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba94ab-a7da-49e5-a773-554f4b0d430a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:15.999698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 739/1482] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:59:16.005165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52b01a-c7e8-443e-8c2f-e7bae9540f05 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:16.005596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52b01a-c7e8-443e-8c2f-e7bae9540f05 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:16.005802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52b01a-c7e8-443e-8c2f-e7bae9540f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:16.023920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8f52b01a-c7e8-443e-8c2f-e7bae9540f05 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:16.025160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8f52b01a-c7e8-443e-8c2f-e7bae9540f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:16.033088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 744/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:16.071310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba94ab-a7da-49e5-a773-554f4b0d430a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:16.081948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba94ab-a7da-49e5-a773-554f4b0d430a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:16.085409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df6ce-0ea9-434e-a1fe-596ebba7d719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:16.086059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df6ce-0ea9-434e-a1fe-596ebba7d719 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:16.086335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df6ce-0ea9-434e-a1fe-596ebba7d719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:16.086604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df6ce-0ea9-434e-a1fe-596ebba7d719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:16.095860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df6ce-0ea9-434e-a1fe-596ebba7d719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:16.097321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df6ce-0ea9-434e-a1fe-596ebba7d719 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:16.107062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 740/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:59:18.441855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951df1-2c44-47c8-a772-a4e37086e27b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:18.442470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951df1-2c44-47c8-a772-a4e37086e27b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:18.442470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951df1-2c44-47c8-a772-a4e37086e27b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:18.443890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 745/1485] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:59:18.450489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400b13-be10-484d-a29b-0b8c6d4b67ec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:18.451029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400b13-be10-484d-a29b-0b8c6d4b67ec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:18.451029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400b13-be10-484d-a29b-0b8c6d4b67ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:18.474831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-42400b13-be10-484d-a29b-0b8c6d4b67ec None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:18.476085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-42400b13-be10-484d-a29b-0b8c6d4b67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:18.484067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 741/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:18.522868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951df1-2c44-47c8-a772-a4e37086e27b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:18.534004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951df1-2c44-47c8-a772-a4e37086e27b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:18.537684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f91c6-0f45-4f2c-9960-29bf009e03f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:18.538342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f91c6-0f45-4f2c-9960-29bf009e03f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:18.538627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f91c6-0f45-4f2c-9960-29bf009e03f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:18.538905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f91c6-0f45-4f2c-9960-29bf009e03f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:18.548892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f91c6-0f45-4f2c-9960-29bf009e03f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:18.550353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f91c6-0f45-4f2c-9960-29bf009e03f7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:18.561545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 746/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:59:21.050595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda56e5-91fc-41d9-93ad-059326a38f5b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:21.051244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda56e5-91fc-41d9-93ad-059326a38f5b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:21.051244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda56e5-91fc-41d9-93ad-059326a38f5b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:21.052594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 742/1488] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 08:59:21.058595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847824a8-9e45-4fe9-b07f-c12517912587 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:21.059515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847824a8-9e45-4fe9-b07f-c12517912587 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:21.059515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847824a8-9e45-4fe9-b07f-c12517912587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:21.079112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-847824a8-9e45-4fe9-b07f-c12517912587 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:21.080385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-847824a8-9e45-4fe9-b07f-c12517912587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:21.088524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 747/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 08:59:21.130373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda56e5-91fc-41d9-93ad-059326a38f5b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:21.142141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda56e5-91fc-41d9-93ad-059326a38f5b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:21.145986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0e31-fa05-4678-a99e-8cae20369746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:21.146642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e31-fa05-4678-a99e-8cae20369746 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:21.146927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e31-fa05-4678-a99e-8cae20369746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:21.147203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e31-fa05-4678-a99e-8cae20369746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:21.157854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0e31-fa05-4678-a99e-8cae20369746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:21.159306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0e31-fa05-4678-a99e-8cae20369746 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:21.170442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 743/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 08:59:23.749525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42571ba5-81c4-4988-a2d0-ef6e5dc166b8 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:23.750371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42571ba5-81c4-4988-a2d0-ef6e5dc166b8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:23.750677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42571ba5-81c4-4988-a2d0-ef6e5dc166b8 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:23.752125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 748/1491] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 08:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 08:59:23.758284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ac5f-0fa9-4afb-9fab-cf2866321160 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:23.758928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ac5f-0fa9-4afb-9fab-cf2866321160 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:23.758928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ac5f-0fa9-4afb-9fab-cf2866321160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:23.792997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b374ac5f-0fa9-4afb-9fab-cf2866321160 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 08:59:23.794274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b374ac5f-0fa9-4afb-9fab-cf2866321160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 08:59:23.804315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 744/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 08:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 08:59:23.843972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42571ba5-81c4-4988-a2d0-ef6e5dc166b8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 08:59:23.855700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42571ba5-81c4-4988-a2d0-ef6e5dc166b8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 08:59:23.859530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af60c6f-1ca8-42bf-b295-5e3e099a16fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 08:59:23.860221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af60c6f-1ca8-42bf-b295-5e3e099a16fc service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 08:59:23.860509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af60c6f-1ca8-42bf-b295-5e3e099a16fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 08:59:23.860821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af60c6f-1ca8-42bf-b295-5e3e099a16fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 08:59:23.870882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af60c6f-1ca8-42bf-b295-5e3e099a16fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 08:59:23.872957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af60c6f-1ca8-42bf-b295-5e3e099a16fc service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 08:59:23.883550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 749/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 08:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 08:59:33.786829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=33 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 08:59:33.878733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=33 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:00:50.330113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.330697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.330697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.348301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:00:50.349463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:50.357862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 745/1494] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:00:50.365969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.366475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.366570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.385761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:00:50.386971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:50.394632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 750/1495] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:00:50.399150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.408851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517b031-7624-4da3-95dc-6c74f6a4c961 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.413367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.414017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.414299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.414575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.415296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:00:50.415604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.416658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:50.416658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:00:50.416658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:00:50.418045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.429802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 746/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:00:50.438403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.447417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccba1a-fcf4-4750-9fca-d4a28cdcb631 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.452009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.452655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.452934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.453204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.453890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.455624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:50.455624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:00:50.455624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:00:50.457586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.493929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 751/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:00:50 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:00:50.499172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.509835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff3eb4-3a92-4f3b-af04-70e8dff1e3f5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.570082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.570757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.571038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.571344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.572032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.573432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:50.573432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:00:50.573432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:00:50.574713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.597750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 747/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:00:50 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:00:50.601827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.613536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb5a9-3666-4eaa-8253-1c38b6d7189d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.618073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.618737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.619016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.619290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.620042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.621095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:50.621095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:00:50.621095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:00:50.621991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.636212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 752/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:00:50.640308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.650423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7c90-6d78-422e-bb5b-fb29a432f13d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.655635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.656407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.656688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.656964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.657693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.658706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:50.658706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:00:50.658706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:00:50.659609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89c15-392a-4ea3-a2fc-1c3863a0449c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.674160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 748/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:00:50.678434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.690710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9742-5f65-4207-8f8b-9c3e18a21698 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.695367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.696288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.696593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.696856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] PATH_INFO: `/v3/projects/1fa91262ae8342c5898204c754ee424b/users/02b5dd5ba48242a891418dbaab178f2f/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.717983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa91262ae8342c5898204c754ee424b, user_id=02b5dd5ba48242a891418dbaab178f2f, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.719077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:50.719077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:00:50.719077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:00:50.721109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075cd1d-f47f-4e9f-95c2-c7b0b740d8fa admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.736476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 753/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:00:50 2022] PUT /identity/v3/projects/1fa91262ae8342c5898204c754ee424b/users/02b5dd5ba48242a891418dbaab178f2f/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:00:50.750006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cef628-69c1-4492-ad59-291184aef571 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.750301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cef628-69c1-4492-ad59-291184aef571 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.750582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cef628-69c1-4492-ad59-291184aef571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.780622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-57cef628-69c1-4492-ad59-291184aef571 None None] MFA Rules not processed for user `02b5dd5ba48242a891418dbaab178f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:00:50.782249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-57cef628-69c1-4492-ad59-291184aef571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:50.848084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 749/1502] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:00:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:00:50.861916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcce4a-2ae2-4fbd-a384-3d9235f787a2 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.862202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcce4a-2ae2-4fbd-a384-3d9235f787a2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.862477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcce4a-2ae2-4fbd-a384-3d9235f787a2 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.863937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 754/1503] 10.222.0.61 () {54 vars in 963 bytes} [Fri Jun 3 09:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:00:50.868815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812440-cc78-4c9e-ae82-3ea45e293318 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.869154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812440-cc78-4c9e-ae82-3ea45e293318 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.869440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812440-cc78-4c9e-ae82-3ea45e293318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.888455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-65812440-cc78-4c9e-ae82-3ea45e293318 None None] MFA Rules not processed for user `c06192133f444b13933b7c4a1997e3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:00:50.889653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-65812440-cc78-4c9e-ae82-3ea45e293318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:50.935427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:00:50.944145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 750/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Fri Jun 3 09:00:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:00:50.953581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcce4a-2ae2-4fbd-a384-3d9235f787a2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:50.965196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcce4a-2ae2-4fbd-a384-3d9235f787a2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:50.968804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:50.969480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:50.969792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:50.970068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:50.979056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:50.980574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:50.989668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 755/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:00:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:00:51.038425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21beeb-5f6b-4b9f-a9e7-e3539c55d666 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:51.038711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21beeb-5f6b-4b9f-a9e7-e3539c55d666 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:51.038990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21beeb-5f6b-4b9f-a9e7-e3539c55d666 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:51.040343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 751/1506] 10.222.0.61 () {52 vars in 829 bytes} [Fri Jun 3 09:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:00:51.043988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:51.110247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf676b-8ce0-4050-8cb8-6d34fa8660b0 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:51.114709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:51.115580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:51.115900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:51.116177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] PATH_INFO: `/v3/users/02b5dd5ba48242a891418dbaab178f2f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:51.117364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b5dd5ba48242a891418dbaab178f2f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:51.118375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:51.118375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:00:51.118375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:00:51.119597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:51.183835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b5dd5ba48242a891418dbaab178f2f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.202324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b5dd5ba48242a891418dbaab178f2f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.203012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b5dd5ba48242a891418dbaab178f2f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.215525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b5dd5ba48242a891418dbaab178f2f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.219628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:00:51.225666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b5dd5ba48242a891418dbaab178f2f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.232683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 756/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:00:51 2022] DELETE /identity/v3/users/02b5dd5ba48242a891418dbaab178f2f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:00:51.242633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:51.242922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:51.243203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:51.260651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:00:51.262422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:51.322550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 752/1508] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:00:51.332796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:51.334196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:51.390781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca779-ded9-4a2c-98d8-3de5b07c8d07 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:51.394448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa1f32-a90f-4def-8172-0203deb7a5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:51.395092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1f32-a90f-4def-8172-0203deb7a5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:51.395376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1f32-a90f-4def-8172-0203deb7a5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:51.395651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1f32-a90f-4def-8172-0203deb7a5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:51.404676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa1f32-a90f-4def-8172-0203deb7a5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:51.406144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa1f32-a90f-4def-8172-0203deb7a5a0 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:51.415648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 757/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:00:51.740789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:00:51.742427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:00:51.754734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106b0b-7275-4a68-a721-028ff809b309 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:00:51.760250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:00:51.761180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:00:51.761460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:00:51.761736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] PATH_INFO: `/v3/projects/1fa91262ae8342c5898204c754ee424b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:00:51.762938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa91262ae8342c5898204c754ee424b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:00:51.764027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:00:51.764027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:00:51.764027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:00:51.765412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:00:51.827968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa91262ae8342c5898204c754ee424b', 'request_id': 'req-4931c422-a93c-45c4-854c-a35fa1902c12'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.834240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa91262ae8342c5898204c754ee424b', 'request_id': 'req-4931c422-a93c-45c4-854c-a35fa1902c12'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.848122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa91262ae8342c5898204c754ee424b', 'request_id': 'req-4931c422-a93c-45c4-854c-a35fa1902c12'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.862845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] The token cache is being invalidate because project 1fa91262ae8342c5898204c754ee424b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:00:51.863134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.863784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4931c422-a93c-45c4-854c-a35fa1902c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:00:51.865433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 753/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:00:51 2022] DELETE /identity/v3/projects/1fa91262ae8342c5898204c754ee424b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:01:01.411421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:01:01.859801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:29.681773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589b2b3-bf45-4ec9-b08e-4bdba1dcb824 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:29.682377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589b2b3-bf45-4ec9-b08e-4bdba1dcb824 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:29.682377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589b2b3-bf45-4ec9-b08e-4bdba1dcb824 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:29.683766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:29.688529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72af0-adf8-4316-b795-74ab9143216c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:29.688966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72af0-adf8-4316-b795-74ab9143216c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:29.689095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72af0-adf8-4316-b795-74ab9143216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:29.707152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4ad72af0-adf8-4316-b795-74ab9143216c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:29.708393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4ad72af0-adf8-4316-b795-74ab9143216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:29.768716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:29.937629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589b2b3-bf45-4ec9-b08e-4bdba1dcb824 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:29.939564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0589b2b3-bf45-4ec9-b08e-4bdba1dcb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:30.014646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589b2b3-bf45-4ec9-b08e-4bdba1dcb824 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:30.020630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e7f4a-6951-405d-a9e5-400becc3a177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:30.021276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7f4a-6951-405d-a9e5-400becc3a177 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:30.021562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7f4a-6951-405d-a9e5-400becc3a177 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:30.021840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7f4a-6951-405d-a9e5-400becc3a177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:30.031524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e7f4a-6951-405d-a9e5-400becc3a177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:30.033920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e7f4a-6951-405d-a9e5-400becc3a177 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:30.044775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 759/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:30.938220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e3e7-5875-40ec-8976-95f0f9e28fe4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:30.938749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e3e7-5875-40ec-8976-95f0f9e28fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:30.938749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e3e7-5875-40ec-8976-95f0f9e28fe4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:30.940297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:30.946282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aeb23-1b2a-4e5e-b617-0ddf90f89455 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:30.946752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aeb23-1b2a-4e5e-b617-0ddf90f89455 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:30.946928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aeb23-1b2a-4e5e-b617-0ddf90f89455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:30.973634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3e9aeb23-1b2a-4e5e-b617-0ddf90f89455 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:30.974835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3e9aeb23-1b2a-4e5e-b617-0ddf90f89455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:30.983211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:31.132568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e3e7-5875-40ec-8976-95f0f9e28fe4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:31.146989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e3e7-5875-40ec-8976-95f0f9e28fe4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:31.152324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17a6a-3a50-4255-adca-3b80ac4fd6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:31.152958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17a6a-3a50-4255-adca-3b80ac4fd6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:31.153237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17a6a-3a50-4255-adca-3b80ac4fd6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:31.153508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17a6a-3a50-4255-adca-3b80ac4fd6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:31.161978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e17a6a-3a50-4255-adca-3b80ac4fd6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:31.163684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e17a6a-3a50-4255-adca-3b80ac4fd6d7 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:31.173845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 756/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:31.556129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a0e4-4ab2-4910-ab98-a641eb7e47b9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:31.556419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a0e4-4ab2-4910-ab98-a641eb7e47b9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:31.556698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a0e4-4ab2-4910-ab98-a641eb7e47b9 None None] PATH_INFO: `/v3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:31.558027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 761/1517] 10.222.0.66 () {54 vars in 925 bytes} [Fri Jun 3 09:02:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:02:31.564101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eeda3-0a96-4512-94c8-e61d64b049f3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:31.564414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eeda3-0a96-4512-94c8-e61d64b049f3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:31.564689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eeda3-0a96-4512-94c8-e61d64b049f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:31.583323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a6eeda3-0a96-4512-94c8-e61d64b049f3 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:31.584367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a6eeda3-0a96-4512-94c8-e61d64b049f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:31.649766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 757/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Fri Jun 3 09:02:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:35.673871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b3af-9586-4862-b28a-03951237c7fd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:35.674450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b3af-9586-4862-b28a-03951237c7fd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:35.674450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b3af-9586-4862-b28a-03951237c7fd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:35.675776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 762/1519] 10.222.0.61 () {54 vars in 960 bytes} [Fri Jun 3 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:35.680996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba7a5-113b-44cc-983f-eda16a85d66b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:35.681456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba7a5-113b-44cc-983f-eda16a85d66b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:35.681555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba7a5-113b-44cc-983f-eda16a85d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:35.699901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-75aba7a5-113b-44cc-983f-eda16a85d66b None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:35.701092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-75aba7a5-113b-44cc-983f-eda16a85d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:35.710272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 758/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Fri Jun 3 09:02:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:35.717813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19b3af-9586-4862-b28a-03951237c7fd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:35.731232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19b3af-9586-4862-b28a-03951237c7fd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:35.736765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045172c1-64d9-47ab-badd-9a3f29bfb286 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:35.737406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045172c1-64d9-47ab-badd-9a3f29bfb286 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:35.737694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045172c1-64d9-47ab-badd-9a3f29bfb286 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:35.737972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045172c1-64d9-47ab-badd-9a3f29bfb286 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:35.746374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045172c1-64d9-47ab-badd-9a3f29bfb286 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:35.748013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045172c1-64d9-47ab-badd-9a3f29bfb286 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:35.758232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 763/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:42.471416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d5886-efb9-49b5-ba8c-4cf626798e37 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:42.471999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d5886-efb9-49b5-ba8c-4cf626798e37 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:42.471999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d5886-efb9-49b5-ba8c-4cf626798e37 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:42.473398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:42.478270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145231a0-99ad-4823-94ae-8238521e8165 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:42.478712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145231a0-99ad-4823-94ae-8238521e8165 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:42.478818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145231a0-99ad-4823-94ae-8238521e8165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:42.496583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-145231a0-99ad-4823-94ae-8238521e8165 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:42.497777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-145231a0-99ad-4823-94ae-8238521e8165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:42.505673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:42.657902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d5886-efb9-49b5-ba8c-4cf626798e37 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:42.674373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d5886-efb9-49b5-ba8c-4cf626798e37 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:42.679686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f504a6-71f0-4356-9c04-ca0e08a523d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:42.680354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f504a6-71f0-4356-9c04-ca0e08a523d8 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:42.680637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f504a6-71f0-4356-9c04-ca0e08a523d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:42.680912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f504a6-71f0-4356-9c04-ca0e08a523d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:42.689106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f504a6-71f0-4356-9c04-ca0e08a523d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:42.690701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f504a6-71f0-4356-9c04-ca0e08a523d8 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:42.700035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 760/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:43.562371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf14a3-44ac-4113-ada4-394117af33ef None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:43.563449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf14a3-44ac-4113-ada4-394117af33ef None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:43.563549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf14a3-44ac-4113-ada4-394117af33ef None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:43.564921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 09:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:43.569821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526fa8-5141-4380-a7ea-aecbd257aceb None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:43.570259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526fa8-5141-4380-a7ea-aecbd257aceb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:43.570409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526fa8-5141-4380-a7ea-aecbd257aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:43.588630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-82526fa8-5141-4380-a7ea-aecbd257aceb None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:43.589835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-82526fa8-5141-4380-a7ea-aecbd257aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:43.598104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 09:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:43.749837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf14a3-44ac-4113-ada4-394117af33ef None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:43.764238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf14a3-44ac-4113-ada4-394117af33ef None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:43.769916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cede4f-979e-482b-ab9d-e8deffe42148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:43.770550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cede4f-979e-482b-ab9d-e8deffe42148 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:43.770834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cede4f-979e-482b-ab9d-e8deffe42148 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:43.771102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cede4f-979e-482b-ab9d-e8deffe42148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:43.779272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cede4f-979e-482b-ab9d-e8deffe42148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:43.780890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cede4f-979e-482b-ab9d-e8deffe42148 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:43.790617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 766/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:48.572742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8fcc9-8d81-43e5-8829-ca5479da00f5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:48.573294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8fcc9-8d81-43e5-8829-ca5479da00f5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:48.573294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8fcc9-8d81-43e5-8829-ca5479da00f5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:48.574791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:48.580473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ad2e-6ad2-44d0-808b-7137c2e9d5bd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:48.580945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ad2e-6ad2-44d0-808b-7137c2e9d5bd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:48.581243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ad2e-6ad2-44d0-808b-7137c2e9d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:48.600638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7db7ad2e-6ad2-44d0-808b-7137c2e9d5bd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:48.601823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7db7ad2e-6ad2-44d0-808b-7137c2e9d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:48.609994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:48.646860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8fcc9-8d81-43e5-8829-ca5479da00f5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:48.648615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c9a8fcc9-8d81-43e5-8829-ca5479da00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:48.715963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8fcc9-8d81-43e5-8829-ca5479da00f5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:48.719544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581abd4d-49b1-4038-bdf2-7822d0d3aa09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:48.720228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581abd4d-49b1-4038-bdf2-7822d0d3aa09 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:48.720504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581abd4d-49b1-4038-bdf2-7822d0d3aa09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:48.720777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581abd4d-49b1-4038-bdf2-7822d0d3aa09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:48.729679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581abd4d-49b1-4038-bdf2-7822d0d3aa09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:48.731133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581abd4d-49b1-4038-bdf2-7822d0d3aa09 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:48.736629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:48.741723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 763/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:51.075951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4da285-0301-4a34-8f70-73da3a08d559 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:51.076540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4da285-0301-4a34-8f70-73da3a08d559 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:51.076964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4da285-0301-4a34-8f70-73da3a08d559 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:51.079281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:51.085803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f67de6-d8fb-4de0-966a-453bc98616eb None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:51.086296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f67de6-d8fb-4de0-966a-453bc98616eb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:51.086452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f67de6-d8fb-4de0-966a-453bc98616eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:51.106460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-81f67de6-d8fb-4de0-966a-453bc98616eb None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:51.107798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-81f67de6-d8fb-4de0-966a-453bc98616eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:51.115529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:51.152099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4da285-0301-4a34-8f70-73da3a08d559 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:51.162990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4da285-0301-4a34-8f70-73da3a08d559 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:51.166614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed4794-d971-4b1b-a4ff-02b07138d610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:51.167258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4794-d971-4b1b-a4ff-02b07138d610 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:51.167542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4794-d971-4b1b-a4ff-02b07138d610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:51.168097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4794-d971-4b1b-a4ff-02b07138d610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:51.177151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed4794-d971-4b1b-a4ff-02b07138d610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:51.178594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed4794-d971-4b1b-a4ff-02b07138d610 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:51.188494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 769/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:54.968124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdd2c0-c852-464d-aec6-2e53d4925ea0 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:54.968643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdd2c0-c852-464d-aec6-2e53d4925ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:54.968643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdd2c0-c852-464d-aec6-2e53d4925ea0 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:54.969991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:54.975385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5d5c-7fa9-4c10-bfff-54a3d373c6ad None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:54.975809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5d5c-7fa9-4c10-bfff-54a3d373c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:54.976053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5d5c-7fa9-4c10-bfff-54a3d373c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:54.982439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=62 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:02:54.995437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f95f5d5c-7fa9-4c10-bfff-54a3d373c6ad None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:54.996670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f95f5d5c-7fa9-4c10-bfff-54a3d373c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:55.004968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:55.276489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdd2c0-c852-464d-aec6-2e53d4925ea0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:55.278365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-86bdd2c0-c852-464d-aec6-2e53d4925ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:55.336772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdd2c0-c852-464d-aec6-2e53d4925ea0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:55.340293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba483b3-463c-4da1-90a1-eced441d854c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:55.340940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba483b3-463c-4da1-90a1-eced441d854c service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:55.341232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba483b3-463c-4da1-90a1-eced441d854c service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:55.341509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba483b3-463c-4da1-90a1-eced441d854c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:55.351283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba483b3-463c-4da1-90a1-eced441d854c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:55.352797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba483b3-463c-4da1-90a1-eced441d854c service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:55.370019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 766/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:02:57.636480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de09d-1943-4951-9667-c5409c2440a1 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:57.637096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de09d-1943-4951-9667-c5409c2440a1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:57.637096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de09d-1943-4951-9667-c5409c2440a1 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:57.638402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 09:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:02:57.644089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4132f0-0efe-4a7d-a37e-c95f2e11517e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:57.644514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4132f0-0efe-4a7d-a37e-c95f2e11517e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:57.644653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4132f0-0efe-4a7d-a37e-c95f2e11517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:57.663078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8f4132f0-0efe-4a7d-a37e-c95f2e11517e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:02:57.664333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8f4132f0-0efe-4a7d-a37e-c95f2e11517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:57.672337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:02:57.945176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723de09d-1943-4951-9667-c5409c2440a1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:02:57.946848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-723de09d-1943-4951-9667-c5409c2440a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:02:57.960441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723de09d-1943-4951-9667-c5409c2440a1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:02:57.964016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb5f4-164b-46e3-a023-9f38ff19ce30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:02:57.964665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb5f4-164b-46e3-a023-9f38ff19ce30 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:02:57.964945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb5f4-164b-46e3-a023-9f38ff19ce30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:02:57.965217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb5f4-164b-46e3-a023-9f38ff19ce30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:02:57.974713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eb5f4-164b-46e3-a023-9f38ff19ce30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:02:57.976193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eb5f4-164b-46e3-a023-9f38ff19ce30 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:02:57.985830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 772/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:03:07.657870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=32 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:03:07.981352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=8 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:30.856719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747f521-e863-4087-9add-80d640d94b94 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:30.857815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747f521-e863-4087-9add-80d640d94b94 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:30.858486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747f521-e863-4087-9add-80d640d94b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:30.892705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9747f521-e863-4087-9add-80d640d94b94 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:30.894278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9747f521-e863-4087-9add-80d640d94b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:30.910137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 768/1540] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:30.921646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:30.922667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:30.923164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:30.950949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:30.953296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:30.979026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 773/1541] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:30.989179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747f521-e863-4087-9add-80d640d94b94 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.010816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747f521-e863-4087-9add-80d640d94b94 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.020106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.021272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.021793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.022319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.023311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:31.023925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.025889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.045806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 769/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:31.055173 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.069865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2b1f-4eca-459c-b2be-74f0006da93d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.081610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da23fab-000b-4c64-8289-99d0c61d71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.082684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23fab-000b-4c64-8289-99d0c61d71d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.083194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23fab-000b-4c64-8289-99d0c61d71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.083687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23fab-000b-4c64-8289-99d0c61d71d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.084643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da23fab-000b-4c64-8289-99d0c61d71d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.086875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da23fab-000b-4c64-8289-99d0c61d71d5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.127735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 774/1543] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:31.131905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.144483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9fd7-8619-4099-b905-aa7e7635690e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.152668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a111-bdc8-4136-93ef-8ca18a3f7f46 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.153427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a111-bdc8-4136-93ef-8ca18a3f7f46 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.154100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a111-bdc8-4136-93ef-8ca18a3f7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.186037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-90f1a111-bdc8-4136-93ef-8ca18a3f7f46 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.188519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-90f1a111-bdc8-4136-93ef-8ca18a3f7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.273383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.274867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.275163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.275472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.277757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.278939 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.311190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 770/1544] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:31.318622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.328706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 775/1545] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:31.332836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0faf8e-9021-4f23-aefb-be1e8343a2e2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.341456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.341699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.342145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.342420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.342735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.343014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.343482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.343736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.345229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.364412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 771/1546] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:04:31.369197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.380128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.381684 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.389208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425de66-4cc3-4538-90f8-14a145a2d205 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.398726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 776/1547] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.402997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.403475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.404242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.404533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.404811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.405662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.407800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.417354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac1329-d2c0-48a1-b8af-592a792cf949 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.427905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 772/1548] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:04:31.430101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.431014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.431519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.431995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.432259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.433175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:31.433668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.434883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:04:31.434883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:04:31.434883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:04:31.436176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.449844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a8bc-f6c1-4bb5-8000-8e3dc951d2ac admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.455926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 777/1549] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:04:31.459221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.460190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.460475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.460753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] PATH_INFO: `/v3/projects/8e442ff861b14d6492a4b27899632a92/users/4a7b71aa00454406ab83a4891a8a719e/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.464265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.483932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ae71-f4f5-4fb0-9305-c2d33e184674 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.488686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e442ff861b14d6492a4b27899632a92, user_id=4a7b71aa00454406ab83a4891a8a719e, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.490064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:04:31.490064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:04:31.490064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:04:31.492074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3e638-99cb-42be-ab62-5d3e828a3dd1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.493889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b278-3e34-43d4-a6da-947c2086d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.494750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b278-3e34-43d4-a6da-947c2086d333 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.495203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b278-3e34-43d4-a6da-947c2086d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.495644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b278-3e34-43d4-a6da-947c2086d333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.496558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1b278-3e34-43d4-a6da-947c2086d333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.498670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1b278-3e34-43d4-a6da-947c2086d333 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.523104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 773/1550] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:31 2022] PUT /identity/v3/projects/8e442ff861b14d6492a4b27899632a92/users/4a7b71aa00454406ab83a4891a8a719e/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:04:31.528834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.529144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.529409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.557107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 778/1551] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:04:31.558706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cee1-6564-408e-a6c5-4e672503fa1c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.559165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cee1-6564-408e-a6c5-4e672503fa1c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.559609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cee1-6564-408e-a6c5-4e672503fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.562346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.563580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.589416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9788cee1-6564-408e-a6c5-4e672503fa1c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.590917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9788cee1-6564-408e-a6c5-4e672503fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.653675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 774/1552] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:31.654612 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.673206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 779/1553] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.673206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9b1e-8450-481a-a3c3-ad0af8c1aaee None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.673206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9b1e-8450-481a-a3c3-ad0af8c1aaee None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.673206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9b1e-8450-481a-a3c3-ad0af8c1aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.679237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0324-e312-45b8-8830-abfa9e72cdfd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.683901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681e07b-603c-4e50-b9ea-88c577bd54ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.684587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e07b-603c-4e50-b9ea-88c577bd54ff admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.684876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e07b-603c-4e50-b9ea-88c577bd54ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.685155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e07b-603c-4e50-b9ea-88c577bd54ff admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.685852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e07b-603c-4e50-b9ea-88c577bd54ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.688623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e07b-603c-4e50-b9ea-88c577bd54ff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.694239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-61aa9b1e-8450-481a-a3c3-ad0af8c1aaee None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.695789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-61aa9b1e-8450-481a-a3c3-ad0af8c1aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.710176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 780/1554] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.715957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.715957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.715957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.716183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 775/1555] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/users => generated 283 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:31.718055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c350-fdec-4645-8924-6e477ce26bb1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.718055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c350-fdec-4645-8924-6e477ce26bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.718274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c350-fdec-4645-8924-6e477ce26bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.730621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.731855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.732013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:31.737857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9dd2c350-fdec-4645-8924-6e477ce26bb1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.739650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9dd2c350-fdec-4645-8924-6e477ce26bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.740548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 781/1556] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.741589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.748263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 776/1557] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.750054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf440d-ec82-47db-a969-0b2af6e8af48 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.750349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf440d-ec82-47db-a969-0b2af6e8af48 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.750627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf440d-ec82-47db-a969-0b2af6e8af48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.762126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:31.769237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-35bf440d-ec82-47db-a969-0b2af6e8af48 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.770517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-35bf440d-ec82-47db-a969-0b2af6e8af48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.778760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 777/1558] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.780309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.780437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.780664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.798529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.799860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.801001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0110-afff-4fd0-8bea-4c7ac6a884e8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.804558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e539-ef38-448a-945b-6a7de4c75da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.805208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e539-ef38-448a-945b-6a7de4c75da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.805496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e539-ef38-448a-945b-6a7de4c75da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.805774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e539-ef38-448a-945b-6a7de4c75da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.807681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 778/1559] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.812024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.818781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e539-ef38-448a-945b-6a7de4c75da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.818960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bba550-820b-4cf9-a1a0-dad48fea337f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.820293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e539-ef38-448a-945b-6a7de4c75da6 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.823459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644b231-a422-4fa4-9bdc-53670a49f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.824155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644b231-a422-4fa4-9bdc-53670a49f6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.824435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644b231-a422-4fa4-9bdc-53670a49f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.824710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644b231-a422-4fa4-9bdc-53670a49f6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.825435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644b231-a422-4fa4-9bdc-53670a49f6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.827105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644b231-a422-4fa4-9bdc-53670a49f6f0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.831089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 782/1560] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:31.832459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ec98-4697-4828-83e7-60b693f0ab1f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.832818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ec98-4697-4828-83e7-60b693f0ab1f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.833170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ec98-4697-4828-83e7-60b693f0ab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.838373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 779/1561] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:31.839858 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13abb7-efaf-4c0c-9282-f24f60c3b75d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.840149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13abb7-efaf-4c0c-9282-f24f60c3b75d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.840432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13abb7-efaf-4c0c-9282-f24f60c3b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.854865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9739ec98-4697-4828-83e7-60b693f0ab1f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.856370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9739ec98-4697-4828-83e7-60b693f0ab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.860438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ef13abb7-efaf-4c0c-9282-f24f60c3b75d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.861639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ef13abb7-efaf-4c0c-9282-f24f60c3b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.867866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 783/1562] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.867866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269288-f1da-4291-a652-a5d0df76de51 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.867866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269288-f1da-4291-a652-a5d0df76de51 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.867866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269288-f1da-4291-a652-a5d0df76de51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.876935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 780/1563] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.878294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.878581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.878855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.894686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b4269288-f1da-4291-a652-a5d0df76de51 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.900012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.901159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b4269288-f1da-4291-a652-a5d0df76de51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.901433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.912877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 781/1564] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.913726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.913979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 784/1565] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.915459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.916022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.916842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.925417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2dea-1639-407c-b3c6-6850c582d650 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.930742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.931570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.931898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.932245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.932997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:31.933304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.935309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4067b9-a7f7-449b-8362-f85b112093b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.938403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.939767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.949558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 785/1566] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.950808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:31.962919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 782/1567] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:31.962919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.962919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.962919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.963433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbb15c-1e84-4a70-bee3-6a4d203a48cf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:31.971013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:31.971926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:31.972210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:31.972658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:31.973393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:31.975124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:31.985663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:31.986973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:31.990538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 786/1568] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:31.996841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 783/1569] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:31.998092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.002508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.010432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471074-937e-41f9-8e35-f7daefa304ba None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.015578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0786b-a13a-4d88-8168-1a75e5c792c2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.016456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.017811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.018171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.018611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.019362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:32.019677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.020226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.021003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.021360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.021463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.022129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.022554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:32.022938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.024896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.047632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 787/1570] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:32.047632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.048132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 784/1571] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:32.048243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.066716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e249-e18a-453c-8ca6-f21b28092aea admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.070125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2d62-c576-4ecb-8e8e-2a717fd56e8e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.073548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.074335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.074625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.074883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.075665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:32.076056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.076791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.077610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.077898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.078172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.078273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.078959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:32.079270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.081921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.095491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 788/1572] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:32.096787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.099096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 785/1573] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:32.105235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.110060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d29ea-4d7e-49dd-97d5-90b704e662c8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.116009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.116691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.117084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.117363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.117498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260deda7-f821-4217-81da-cb342a4f02bc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.118065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.120063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.122514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.123625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.124723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.125071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] PATH_INFO: `/v3/projects/94ca27045de94ea29fc11f7ee5f4174b/users/aaf749068e63460b9678d0e50a946fa7/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.145060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ca27045de94ea29fc11f7ee5f4174b, user_id=aaf749068e63460b9678d0e50a946fa7, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.149554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.161154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 789/1574] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.161829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.168383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 786/1575] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:32 2022] PUT /identity/v3/projects/94ca27045de94ea29fc11f7ee5f4174b/users/aaf749068e63460b9678d0e50a946fa7/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:32.169802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.242780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de9506-7186-4bc4-bf6a-de5ade83c6b5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.248170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.249600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.249860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.250147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.250916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:32.251242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.253036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.260024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285f362-0f27-4a48-b6a9-cf9e6b70ab52 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.265492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.266484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.266723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.267178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.268221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.269549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:04:32.269549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:04:32.269549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:04:32.270581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 790/1576] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:32.271603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.277023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.283978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f5a06-cd70-47a2-85be-d1310d18c60e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.289390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.290220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.290567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.290950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.292022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.294749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.316838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 787/1577] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.318188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.336919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 791/1578] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.336919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.354946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:32.378744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:32.408144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b3fc-3c38-4be4-af27-8b00a69c44ad admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.425463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19959433-4a12-4df2-a0d1-f2192415298f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.430752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.431820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.432109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.432387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.433081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.435065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.473280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 792/1579] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.474253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.486277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b45e4-fc85-4a8b-8ac2-ee1c4099687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.486969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b45e4-fc85-4a8b-8ac2-ee1c4099687a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.487244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b45e4-fc85-4a8b-8ac2-ee1c4099687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.487521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b45e4-fc85-4a8b-8ac2-ee1c4099687a admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.488253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b45e4-fc85-4a8b-8ac2-ee1c4099687a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.490219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b45e4-fc85-4a8b-8ac2-ee1c4099687a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.523514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 788/1580] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.525009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.525307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.525620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.555189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab3648-690e-4cd0-b3c0-c45a7f5c68c8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.555717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] MFA Rules not processed for user `aaf749068e63460b9678d0e50a946fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:32.557904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:32.630654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.631599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.632022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.632308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.633117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.634197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:04:32.634197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:04:32.634197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:04:32.635783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.648565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 789/1581] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:32.652785 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.657984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 793/1582] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.658441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.663491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec26a31-3592-42d5-8a3e-80ff5f835231 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.671303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.673658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f15ec-180b-4101-93dd-1e85a5798295 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.679019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.679642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.679959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.680238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.680936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.682967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.683637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.684025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.687478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.688321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.690568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.710382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 794/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.711626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.726308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555e1b-7c51-4e5d-b471-f41462ce537a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.736884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.737577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.737866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.739654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.740397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.742369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.755557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 790/1584] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.757081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.766620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:32.778481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 795/1585] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/users => generated 295 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.779552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.792310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137599b-dfa1-422c-9432-856d031fad7c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.811266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:32.841320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec856d-4356-4ece-9368-9bd1a6f262be admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.848245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.849055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.849255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.849926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.850478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.853821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.882904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 791/1586] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.883833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.886374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.887460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.888000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.888528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.889499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.893340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.897066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c0f76-5c85-40ba-96e7-f88d2994cbf3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.901930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.902624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.902898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.903181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.904296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.906138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.918796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 792/1587] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:32.919672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.925472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 796/1588] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:32.927364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.942616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199b690-9b09-4478-9872-e982b4fd49f8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.948909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.949592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.949878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.950158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.950895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.952961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:32.971320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 797/1589] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:32.971320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:32.982198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf568e-0c22-4986-b774-4bce3acd8bad admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:32.992499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:32.993467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:32.993840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:32.994021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:32.995316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:32.996740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.024507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 798/1590] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:32 2022] POST /identity/v3/users => generated 279 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:33.025577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.028901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ee733-2854-448b-8707-22a0704cd140 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.034256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.034931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.035217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.035523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.038755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bdd02-9fd5-43c6-84db-1de9a7114e6f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.046428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.047355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.047868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.048527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.050133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.052583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.074788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 799/1591] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.076986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.091952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c1ae9-3bd8-46bc-94a0-f025589db259 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.095989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.096751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.097160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.097659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.098673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.100807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.118014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 800/1592] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.118598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.130155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3511-6cec-4d57-8eab-32a633bbab73 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.134978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.135180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.135875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.136162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.136438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.136709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.137650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.138990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.149717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 793/1593] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:33.150661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.164522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 801/1594] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.165660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.167447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2a6e-c06a-4804-a8c6-237874748503 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.180415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202f93-7551-46e9-979a-70d9505abd5a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.180651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.181316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.181604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.182463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.186135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.186374 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.187208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.187601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.188430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.188563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.189429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.191089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.203431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 802/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.208015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.221189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 794/1596] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.222404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.224067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b018e5-646c-4764-9f02-0adb0a5a4c59 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.229881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.230667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.230955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.231234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.232048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.233862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.244239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c395ae-5944-4338-8ca5-d1065e5c0965 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.257043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.258573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.260238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 803/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.260818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.261489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.262569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.263962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.265185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.282755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 795/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.283821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.290099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893f64-deaf-4020-91a8-cada252151ed admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.296350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ee72-b737-499a-accb-7b904a5e6eb9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.303314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.303314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.303314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.303314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.303639 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.314527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.316059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.316450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.316851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] PATH_INFO: `/v3/projects/2cf3dca9396a42c9aeab870da78e3b73/users/0072a982066a4076833cfc2881b12693/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.317774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.335692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 804/1599] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.336575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.338441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf3dca9396a42c9aeab870da78e3b73, user_id=0072a982066a4076833cfc2881b12693, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.342219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.350467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c338-9627-4379-9bfd-a7ad84f1ead1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.358421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.362934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.362934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.363806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 796/1600] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:33 2022] PUT /identity/v3/projects/2cf3dca9396a42c9aeab870da78e3b73/users/0072a982066a4076833cfc2881b12693/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:33.367809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] PATH_INFO: `/v3/projects/f719985a98db414f873a2620b1ba980b/users/25fb4e59d5414fe9a2772469e9a956b5/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.376653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.410852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f719985a98db414f873a2620b1ba980b, user_id=25fb4e59d5414fe9a2772469e9a956b5, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.414780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.431256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:33.458910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 805/1601] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:33 2022] PUT /identity/v3/projects/f719985a98db414f873a2620b1ba980b/users/25fb4e59d5414fe9a2772469e9a956b5/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:33.459986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.538819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1de2a-00cd-4972-a288-7395de460041 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.557058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:33.628504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb092d8c-3da6-4814-b1d2-03483c3c7ca4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.640247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.641115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.641446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.641832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.642575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.644747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.670046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 806/1602] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.671487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.680208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.680914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.681197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.681471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.682296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.684245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.685701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83675e3b-a0b8-4ae3-95e4-d5a74ea9507d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.695234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1c999-0e4e-4f01-a480-d0d0115b2756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.696623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1c999-0e4e-4f01-a480-d0d0115b2756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.697186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1c999-0e4e-4f01-a480-d0d0115b2756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.697687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1c999-0e4e-4f01-a480-d0d0115b2756 admin admin] PATH_INFO: `/v3/projects/fd9b906119034d8ea425a5b768b39e39/users/22457f943fb84f0794695a132f93a3c3/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.704439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 797/1603] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:33.705447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:33.717033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7aef1-cf68-4146-88ca-760e517d4f8d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:33.725580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e51a4-d8fa-4f01-8336-bf01a02819be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:33.726533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e51a4-d8fa-4f01-8336-bf01a02819be admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.727545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e51a4-d8fa-4f01-8336-bf01a02819be admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.727848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e51a4-d8fa-4f01-8336-bf01a02819be admin admin] PATH_INFO: `/v3/projects/5a17189151294d619cfe62968c457c76/users/20f0b0b65d2243ef921c870ec24c745b/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.730021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1c999-0e4e-4f01-a480-d0d0115b2756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9b906119034d8ea425a5b768b39e39, user_id=22457f943fb84f0794695a132f93a3c3, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.734559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1c999-0e4e-4f01-a480-d0d0115b2756 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.767031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e51a4-d8fa-4f01-8336-bf01a02819be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a17189151294d619cfe62968c457c76, user_id=20f0b0b65d2243ef921c870ec24c745b, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:33.769794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 807/1604] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:33 2022] PUT /identity/v3/projects/fd9b906119034d8ea425a5b768b39e39/users/22457f943fb84f0794695a132f93a3c3/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:33.770913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.771202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.771486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.773970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e51a4-d8fa-4f01-8336-bf01a02819be admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:33.803806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 798/1605] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:33 2022] PUT /identity/v3/projects/5a17189151294d619cfe62968c457c76/users/20f0b0b65d2243ef921c870ec24c745b/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:33.803806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:33.803806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:33.803806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:33.838724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:33.840994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] MFA Rules not processed for user `0072a982066a4076833cfc2881b12693`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:33.841990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:33.842162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:34.008423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 799/1606] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:34.009066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.027169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd07d-e2b0-4f8d-b06b-a607b38fbefe None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.052514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e0c1-a31e-47c2-be70-4ccea92586a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.055900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e0c1-a31e-47c2-be70-4ccea92586a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.058404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e0c1-a31e-47c2-be70-4ccea92586a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.058939 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e0c1-a31e-47c2-be70-4ccea92586a1 admin admin] PATH_INFO: `/v3/projects/6be943ae107a44b3b2dc7d2f4b488a45/users/8a18e0fb03154970b39f9d1db624d4fa/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.067141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 808/1607] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:34.072111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.091896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c169-7a0b-422e-abdd-39dd4595d8d3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.096921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197e0c1-a31e-47c2-be70-4ccea92586a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be943ae107a44b3b2dc7d2f4b488a45, user_id=8a18e0fb03154970b39f9d1db624d4fa, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.101092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197e0c1-a31e-47c2-be70-4ccea92586a1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.106651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb4a57-67f8-40ea-8786-cef641a43ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.107262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb4a57-67f8-40ea-8786-cef641a43ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.107551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb4a57-67f8-40ea-8786-cef641a43ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.107853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb4a57-67f8-40ea-8786-cef641a43ba3 admin admin] PATH_INFO: `/v3/projects/99ce551f4cd746c5ac1ae384af7335e1/users/7a7cc1f17baa4e56b103fd0038ca2297/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.130459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 800/1608] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:34 2022] PUT /identity/v3/projects/6be943ae107a44b3b2dc7d2f4b488a45/users/8a18e0fb03154970b39f9d1db624d4fa/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:34.132008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.132300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.132577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.146324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb4a57-67f8-40ea-8786-cef641a43ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ce551f4cd746c5ac1ae384af7335e1, user_id=7a7cc1f17baa4e56b103fd0038ca2297, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.154039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb4a57-67f8-40ea-8786-cef641a43ba3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.180029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:34.181654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 809/1609] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:34 2022] PUT /identity/v3/projects/99ce551f4cd746c5ac1ae384af7335e1/users/7a7cc1f17baa4e56b103fd0038ca2297/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:34.182154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:34.183054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.183342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.183614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.215456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:34.244006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] MFA Rules not processed for user `20f0b0b65d2243ef921c870ec24c745b`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:34.245592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:34.285665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 801/1610] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:34.286903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.332131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:34.341565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 810/1611] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:34.343585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.361039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cd507-fbce-4834-891c-325e74dabb66 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.367405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67534d6-3aa1-43b7-8273-664586205fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.368123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67534d6-3aa1-43b7-8273-664586205fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.368406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67534d6-3aa1-43b7-8273-664586205fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.368689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67534d6-3aa1-43b7-8273-664586205fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.369388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67534d6-3aa1-43b7-8273-664586205fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.371403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67534d6-3aa1-43b7-8273-664586205fe5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.376863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140094c-41c2-4b86-b69d-aa11caca6f3e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.384692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a59f6-3d2e-47ca-93dd-54b7a314c633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.385716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a59f6-3d2e-47ca-93dd-54b7a314c633 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.386200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a59f6-3d2e-47ca-93dd-54b7a314c633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.386760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a59f6-3d2e-47ca-93dd-54b7a314c633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.400024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a59f6-3d2e-47ca-93dd-54b7a314c633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.401848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a59f6-3d2e-47ca-93dd-54b7a314c633 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.408937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 811/1612] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:34.408937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6263-ed22-4f9f-a8fc-75088164e140 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.408937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6263-ed22-4f9f-a8fc-75088164e140 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.408937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6263-ed22-4f9f-a8fc-75088164e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.420534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 802/1613] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:34.421806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.422287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.422481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.466439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] MFA Rules not processed for user `7a7cc1f17baa4e56b103fd0038ca2297`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:34.470300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:34.476239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a45a6263-ed22-4f9f-a8fc-75088164e140 None None] MFA Rules not processed for user `8a18e0fb03154970b39f9d1db624d4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:34.477949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a45a6263-ed22-4f9f-a8fc-75088164e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:34.647413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 803/1614] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:34.648875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.677311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 812/1615] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:34.679846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb202-c653-4a5a-a4e3-68c3f4f997a9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.680198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb202-c653-4a5a-a4e3-68c3f4f997a9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.680481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb202-c653-4a5a-a4e3-68c3f4f997a9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.684925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 813/1616] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 09:04:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:04:34.687636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fb202-c653-4a5a-a4e3-68c3f4f997a9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.820724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2c111-c9e2-4c9d-8f24-200b2c765b65 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.824377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fb202-c653-4a5a-a4e3-68c3f4f997a9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.833394 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.834316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.834746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.835054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.836070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.836274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.836858 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.837153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.837470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.838942 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.850433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:34.855514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.872218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.886452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 814/1617] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:34.886452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.895805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785b10-4593-49ea-b74a-bb1ba2904062 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.896853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 804/1618] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:34.898136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:34.903297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9221-8ed9-4207-bde4-b2cbefffa3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.904033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9221-8ed9-4207-bde4-b2cbefffa3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.904322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9221-8ed9-4207-bde4-b2cbefffa3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.905068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9221-8ed9-4207-bde4-b2cbefffa3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.905964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9221-8ed9-4207-bde4-b2cbefffa3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.908923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9221-8ed9-4207-bde4-b2cbefffa3e6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.925684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5cca-dd0e-406f-8645-99b462a0e054 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:34.939515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:34.941026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.941812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.943205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.946537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:34.951188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:34.958097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 815/1619] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:34.961127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:34.962129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:34.963179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:34.995959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:34.997483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:35.039904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 805/1620] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/projects => generated 355 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:35.042434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.070532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:35.150232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 816/1621] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:35.151418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.299711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8bd9-27a0-4a8f-b84f-e354b297d2c5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.313635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.314360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.317782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.318151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.319325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.323126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd1da9-f89f-425c-abdf-dde1f81bbb5e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.325048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.330452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.331531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.332930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.333422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.334377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.336894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.351943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 806/1622] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:35.352983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.375855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 817/1623] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:35 2022] POST /identity/v3/users => generated 309 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:35.378134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.383699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372406b-3e94-4622-a8c3-462fed20dc29 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.390807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.391510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.391820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.392105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.394890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.397118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.445404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 807/1624] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:35 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:35.446355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.471155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3fd29-5da8-4f3a-a1c9-18993e742dc7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.479686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.480834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.481188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.488942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] PATH_INFO: `/v3/projects/1739ee87e7ff4841880c8444ee34b6d7/users/54bff756f3414938a8ccb57834f4ff8a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.533604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1739ee87e7ff4841880c8444ee34b6d7, user_id=54bff756f3414938a8ccb57834f4ff8a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.543432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.574903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 808/1625] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:35 2022] PUT /identity/v3/projects/1739ee87e7ff4841880c8444ee34b6d7/users/54bff756f3414938a8ccb57834f4ff8a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:35.577167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.584279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d94831-ef0f-438a-962e-ae3af42c7b08 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.678101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:35.704644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.705649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.705989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.706276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.731177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e914c5-a8c1-4c90-b9ce-215f4b43bc60 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.745038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.745818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.746084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.746588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.747473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.756147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.796028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 809/1626] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:35.796028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.796871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.808557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.831923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810bfb3-399e-4a92-b637-baf285ca8404 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.836273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 818/1627] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:35.858688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.876802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.877939 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.878472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.879233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.880233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.883209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.919166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f0a3-78bf-40df-8f0e-541dc34db9cd service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.936323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 810/1628] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:35.942325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.943450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.943970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.944442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:35.945711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:35.946144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:35.948712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:35.966528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c313d5-e3f1-400d-abbc-615922197bf0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:35.973718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:35.974970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:35.978877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:35.979500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] PATH_INFO: `/v3/projects/4d01b6216ece49e1bf3e55459077ce0d/users/42085e065571487fb5e4a8dcd5790f79/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.006128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.017172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d01b6216ece49e1bf3e55459077ce0d, user_id=42085e065571487fb5e4a8dcd5790f79, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.018096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 819/1629] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:36.019201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:36.022572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.040247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cb4e6-6ac7-46c5-a681-266e6e67b5a5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:36.052918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:36.053730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.054012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.054284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] PATH_INFO: `/v3/projects/e8dbf91ff1794367a2fc390e6ad541ce/users/c4863e3906954fb5b48ca6af1dec83eb/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.057488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 811/1630] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:35 2022] PUT /identity/v3/projects/4d01b6216ece49e1bf3e55459077ce0d/users/42085e065571487fb5e4a8dcd5790f79/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:36.063305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:36.093848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dbf91ff1794367a2fc390e6ad541ce, user_id=c4863e3906954fb5b48ca6af1dec83eb, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.096763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.129221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 820/1631] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:36 2022] PUT /identity/v3/projects/e8dbf91ff1794367a2fc390e6ad541ce/users/c4863e3906954fb5b48ca6af1dec83eb/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:36.130099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:36.204843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c01a1-7d95-4d89-aaf7-34783a255416 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:36.265554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756eb8b-c200-4ac5-855d-1cd9e4770b10 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:36.280206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:36.281177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.282102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.282102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.283143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.285399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.309374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 821/1632] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:36.309374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:36.326065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020e82-4831-4ea6-993b-6f1c66ced3a3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:36.333253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19b87-1cbd-42a8-8cb5-8ea7ad36a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:36.333410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:36.334553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19b87-1cbd-42a8-8cb5-8ea7ad36a340 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.335070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.335264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19b87-1cbd-42a8-8cb5-8ea7ad36a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.335782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.336271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19b87-1cbd-42a8-8cb5-8ea7ad36a340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.336879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] PATH_INFO: `/v3/projects/1739ee87e7ff4841880c8444ee34b6d7/users/54bff756f3414938a8ccb57834f4ff8a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.337671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da19b87-1cbd-42a8-8cb5-8ea7ad36a340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.339536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1739ee87e7ff4841880c8444ee34b6d7, user_id=54bff756f3414938a8ccb57834f4ff8a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.340711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da19b87-1cbd-42a8-8cb5-8ea7ad36a340 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.342991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.360067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 812/1633] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:36 2022] PUT /identity/v3/projects/1739ee87e7ff4841880c8444ee34b6d7/users/54bff756f3414938a8ccb57834f4ff8a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:36.363246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:36.396820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 822/1634] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:36.399217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b3ae-8c47-47a4-bde8-e8846487cc84 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.400260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b3ae-8c47-47a4-bde8-e8846487cc84 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.400260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b3ae-8c47-47a4-bde8-e8846487cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.458041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1cf2b3ae-8c47-47a4-bde8-e8846487cc84 None None] MFA Rules not processed for user `54bff756f3414938a8ccb57834f4ff8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:36.459413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1cf2b3ae-8c47-47a4-bde8-e8846487cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:36.497752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c935-53cf-4721-be73-45252d006277 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:36.501457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.505942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:36.507667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.508284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.508740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] PATH_INFO: `/v3/projects/4d01b6216ece49e1bf3e55459077ce0d/users/42085e065571487fb5e4a8dcd5790f79/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.512396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d01b6216ece49e1bf3e55459077ce0d, user_id=42085e065571487fb5e4a8dcd5790f79, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.518859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.545838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 813/1635] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:36 2022] PUT /identity/v3/projects/4d01b6216ece49e1bf3e55459077ce0d/users/42085e065571487fb5e4a8dcd5790f79/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:36.546861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:36.591907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 823/1636] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:36.594318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450cf03-3ec5-4bc2-b6a6-f35e7e05e65e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.594830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450cf03-3ec5-4bc2-b6a6-f35e7e05e65e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.595501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450cf03-3ec5-4bc2-b6a6-f35e7e05e65e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.597456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 824/1637] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 09:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:04:36.600602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.601776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.602291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.618730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:36.714190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925445-0d08-4266-83e7-0bedd0bf0000 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:36.727649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a5b38-b8f9-41ce-bd9b-dd41b299b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:36.728855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a5b38-b8f9-41ce-bd9b-dd41b299b37d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.729123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a5b38-b8f9-41ce-bd9b-dd41b299b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.729392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a5b38-b8f9-41ce-bd9b-dd41b299b37d admin admin] PATH_INFO: `/v3/projects/e8dbf91ff1794367a2fc390e6ad541ce/users/c4863e3906954fb5b48ca6af1dec83eb/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.729776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] MFA Rules not processed for user `42085e065571487fb5e4a8dcd5790f79`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:36.733741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a5b38-b8f9-41ce-bd9b-dd41b299b37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dbf91ff1794367a2fc390e6ad541ce, user_id=c4863e3906954fb5b48ca6af1dec83eb, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:36.737972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:36.740743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a5b38-b8f9-41ce-bd9b-dd41b299b37d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:36.781197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 814/1638] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:36 2022] PUT /identity/v3/projects/e8dbf91ff1794367a2fc390e6ad541ce/users/c4863e3906954fb5b48ca6af1dec83eb/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:36.781197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397c99c-cc26-4309-be92-958e8f31663a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:36.781197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397c99c-cc26-4309-be92-958e8f31663a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:36.781197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397c99c-cc26-4309-be92-958e8f31663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:36.821015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f397c99c-cc26-4309-be92-958e8f31663a None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:36.827504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f397c99c-cc26-4309-be92-958e8f31663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:36.945897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 825/1639] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:36.952520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:37.019845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 815/1640] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:37.021367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335064e-c520-4a1c-bc27-e0e4a13a0039 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.021714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335064e-c520-4a1c-bc27-e0e4a13a0039 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.021942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335064e-c520-4a1c-bc27-e0e4a13a0039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.084695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9335064e-c520-4a1c-bc27-e0e4a13a0039 None None] MFA Rules not processed for user `c4863e3906954fb5b48ca6af1dec83eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:37.097956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9335064e-c520-4a1c-bc27-e0e4a13a0039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:37.098297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966758-7c08-41cc-a82c-9f43b1671a09 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:37.238726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9898a87-5811-4464-88ca-740803dac9b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:37.240115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898a87-5811-4464-88ca-740803dac9b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.240563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898a87-5811-4464-88ca-740803dac9b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.242350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9898a87-5811-4464-88ca-740803dac9b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.283255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:37.294693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 816/1641] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:37.296082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa801-3757-45a7-b609-fc9400f685ed None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.296382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa801-3757-45a7-b609-fc9400f685ed None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.296663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa801-3757-45a7-b609-fc9400f685ed None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.302541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 817/1642] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 09:04:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:04:37.303380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa801-3757-45a7-b609-fc9400f685ed None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:37.333098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa801-3757-45a7-b609-fc9400f685ed None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:37.360320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27aac6-ae49-4ff3-9847-11387f0fdb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:37.361910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27aac6-ae49-4ff3-9847-11387f0fdb09 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.362222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27aac6-ae49-4ff3-9847-11387f0fdb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.362495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27aac6-ae49-4ff3-9847-11387f0fdb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.448123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:37.480175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9898a87-5811-4464-88ca-740803dac9b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:37.495403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9898a87-5811-4464-88ca-740803dac9b9 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:37.508272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27aac6-ae49-4ff3-9847-11387f0fdb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:37.509955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27aac6-ae49-4ff3-9847-11387f0fdb09 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:37.538705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 818/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:37.541318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fe0d-cac1-4b08-8342-80202e432f2b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.542592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fe0d-cac1-4b08-8342-80202e432f2b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.544144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fe0d-cac1-4b08-8342-80202e432f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.561969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 826/1644] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:37.565935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455153c-c8cb-4520-b46d-dc40531820e1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.566427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455153c-c8cb-4520-b46d-dc40531820e1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.566905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455153c-c8cb-4520-b46d-dc40531820e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.633468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0455153c-c8cb-4520-b46d-dc40531820e1 None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:37.634735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0455153c-c8cb-4520-b46d-dc40531820e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:37.677372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 827/1645] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:37.681919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b752fe0d-cac1-4b08-8342-80202e432f2b None None] MFA Rules not processed for user `25fb4e59d5414fe9a2772469e9a956b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:37.684487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54a92-d038-4558-8164-cd993da2066e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.684857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54a92-d038-4558-8164-cd993da2066e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.685001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54a92-d038-4558-8164-cd993da2066e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.687448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 828/1646] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 09:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:04:37.688704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b752fe0d-cac1-4b08-8342-80202e432f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:37.696377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.696734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.697018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.741483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:37.742862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:37.781835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 829/1647] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:37.782877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:37.808138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3be9c6-1a34-4ad3-9977-42c53225d748 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:37.824503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:37.825191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.825475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.825749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.841447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:37.843360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:37.865472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 830/1648] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:37.866730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:37.877904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49065a8b-0507-4255-a954-e9cbdffdc4d8 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:37.884442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 819/1649] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:37.893021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:37.894068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99b064-3643-4114-a100-26eed17cd492 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.894349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99b064-3643-4114-a100-26eed17cd492 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.894811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99b064-3643-4114-a100-26eed17cd492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.896202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:37.896838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:37.897322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:37.914205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:37.917216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:37.929663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-af99b064-3643-4114-a100-26eed17cd492 None None] MFA Rules not processed for user `25fb4e59d5414fe9a2772469e9a956b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:37.934065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-af99b064-3643-4114-a100-26eed17cd492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:37.947700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 831/1650] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:37.954307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 820/1651] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:38.203014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:38.218769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed656a-2920-4c1a-aea4-defe5709f947 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:38.230144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:38.230827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:38.231113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:38.231838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:38.267950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:38.270761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:38.300028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 832/1652] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:38.384644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99b064-3643-4114-a100-26eed17cd492 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:38.402727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99b064-3643-4114-a100-26eed17cd492 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:38.412053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb95c8-a3d2-420c-b0ee-bf9830568416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:38.413998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb95c8-a3d2-420c-b0ee-bf9830568416 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:38.414283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb95c8-a3d2-420c-b0ee-bf9830568416 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:38.421353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb95c8-a3d2-420c-b0ee-bf9830568416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:38.436977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb95c8-a3d2-420c-b0ee-bf9830568416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:38.448494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb95c8-a3d2-420c-b0ee-bf9830568416 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:38.462159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 821/1653] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:38.753858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:38.767241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0006f-5a7c-4f3f-82a6-9fadf24a9f1b service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:38.780994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:38.781676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:38.789837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:38.790194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:38.961204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:39.000217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:39.000217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 833/1654] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:39.241410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5746c9-91ac-4d6f-9a97-023f66a5b450 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:39.241703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5746c9-91ac-4d6f-9a97-023f66a5b450 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:39.242148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5746c9-91ac-4d6f-9a97-023f66a5b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:39.324211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:39.325613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0d5746c9-91ac-4d6f-9a97-023f66a5b450 None None] MFA Rules not processed for user `4a7b71aa00454406ab83a4891a8a719e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:39.333065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0d5746c9-91ac-4d6f-9a97-023f66a5b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:39.504549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 822/1655] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:39.518708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3137-5e86-41dd-b4e4-da50d43bb29b service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:39.531903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:39.532815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:39.533395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:39.533681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] PATH_INFO: `/v3/users/7a7cc1f17baa4e56b103fd0038ca2297` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:39.535621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7cc1f17baa4e56b103fd0038ca2297)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:39.539791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:39.548992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:39.642583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7cc1f17baa4e56b103fd0038ca2297'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:39.667150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7cc1f17baa4e56b103fd0038ca2297'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:39.672328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7cc1f17baa4e56b103fd0038ca2297'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:39.689771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7cc1f17baa4e56b103fd0038ca2297'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:39.705467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7cc1f17baa4e56b103fd0038ca2297'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:39.717097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 834/1656] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:39 2022] DELETE /identity/v3/users/7a7cc1f17baa4e56b103fd0038ca2297 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:04:39.721040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:39.721334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:39.721618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:39.735945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:39.737679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:39.763865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:39.765360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:39.821896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:39.914291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6507f1-8628-42a5-8b87-36758d53b820 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:39.924788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:39.926163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:39.926457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:39.926796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:39.929310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:39.952201 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 823/1657] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:39.955066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:39.969879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:40.048871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.053905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.066433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 835/1658] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:40.080068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:40.081868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:40.088780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db853-e6a2-446e-9ace-3b746c208c1b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:40.098274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54bff756f3414938a8ccb57834f4ff8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1739ee87e7ff4841880c8444ee34b6d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:40.099095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.099397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.099669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.100515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:40.101048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.103936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a80ce-dffd-4b33-92cf-23d79af8b174 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.120105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:40.128366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 824/1659] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:40.131519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7564c-53d1-4be4-b1eb-88f3adb6a7ff None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.132218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7564c-53d1-4be4-b1eb-88f3adb6a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.132550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7564c-53d1-4be4-b1eb-88f3adb6a7ff None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.134993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 825/1660] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 09:04:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:04:40.135697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7564c-53d1-4be4-b1eb-88f3adb6a7ff None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:40.157919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7564c-53d1-4be4-b1eb-88f3adb6a7ff None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:40.164845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623e14d-5fb8-4911-a4e1-cbfe81e267f5 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54bff756f3414938a8ccb57834f4ff8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1739ee87e7ff4841880c8444ee34b6d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:40.165631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e14d-5fb8-4911-a4e1-cbfe81e267f5 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.166949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e14d-5fb8-4911-a4e1-cbfe81e267f5 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.167298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e14d-5fb8-4911-a4e1-cbfe81e267f5 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.168043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e14d-5fb8-4911-a4e1-cbfe81e267f5 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.172771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e14d-5fb8-4911-a4e1-cbfe81e267f5 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.176722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e3bdb-41cf-440c-b845-5e575c59b1a2 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:40.182327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:40.183103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.183454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.183831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.206803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.208516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.214653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 826/1661] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:40 2022] POST /identity/v3/projects => generated 355 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:40.216499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.218581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.219089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.225126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 836/1662] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:40.226658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:40.251661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127291f-142f-4c3a-8f0e-bb217f8daccf service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:40.350918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:40.352569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:40.417771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54bff756f3414938a8ccb57834f4ff8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1739ee87e7ff4841880c8444ee34b6d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:40.418466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.418754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.422056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.422576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:40.422918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.424614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.460491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 827/1663] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:04:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:40.481511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:40.482949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:40.484055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 837/1664] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:40.508972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45d2e0-c138-4d48-ad89-20cb402fe45e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:40.513843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:40.515480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.515888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.516237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.527627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:40.533739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.535368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.539816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442177-6b77-4520-8a54-b51c02e74223 tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:40.548604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 828/1665] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:40.555535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54bff756f3414938a8ccb57834f4ff8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1739ee87e7ff4841880c8444ee34b6d7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:40.557352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:40.557884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:40.558383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] PATH_INFO: `/v3/projects/eca826fc9c41497389de1aca1b145937` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:40.560463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eca826fc9c41497389de1aca1b145937)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:40.562446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: WARNING py.warnings [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:04:40.562446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 09:04:40.562446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: Jun 03 09:04:40.564206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:40.688225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca826fc9c41497389de1aca1b145937', 'request_id': 'req-7ed420df-ef28-469c-87b4-9e41288bb43c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:40.688780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:40.691301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:40.708123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca826fc9c41497389de1aca1b145937', 'request_id': 'req-7ed420df-ef28-469c-87b4-9e41288bb43c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:40.746394 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca826fc9c41497389de1aca1b145937', 'request_id': 'req-7ed420df-ef28-469c-87b4-9e41288bb43c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:40.786779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] The token cache is being invalidate because project eca826fc9c41497389de1aca1b145937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:40.787079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:40.792257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:40.799577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 838/1666] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:40 2022] DELETE /identity/v3/projects/eca826fc9c41497389de1aca1b145937 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:40.802237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:40.957017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad1c3a-157d-448b-b497-1d6986f5b07e service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:41.106814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:41.108760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:41.109355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:41.110256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] PATH_INFO: `/v3/projects/99ce551f4cd746c5ac1ae384af7335e1` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:41.112159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ce551f4cd746c5ac1ae384af7335e1)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:41.116366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:41.221853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ce551f4cd746c5ac1ae384af7335e1', 'request_id': 'req-7947bd19-90d5-4258-a874-dc7c39825bdf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.239550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ce551f4cd746c5ac1ae384af7335e1', 'request_id': 'req-7947bd19-90d5-4258-a874-dc7c39825bdf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.263179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ce551f4cd746c5ac1ae384af7335e1', 'request_id': 'req-7947bd19-90d5-4258-a874-dc7c39825bdf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.290300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] The token cache is being invalidate because project 99ce551f4cd746c5ac1ae384af7335e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:41.292647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.294827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.310335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 829/1667] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:40 2022] DELETE /identity/v3/projects/99ce551f4cd746c5ac1ae384af7335e1 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:41.316600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:41.320350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:41.369354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed420df-ef28-469c-87b4-9e41288bb43c tempest-VolumeQuotaClassesTest-827723470 tempest-VolumeQuotaClassesTest-827723470-project-admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:41.448154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:41.513411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:41.514401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:41.514687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:41.514966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] PATH_INFO: `/v3/users/42085e065571487fb5e4a8dcd5790f79` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:41.517316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42085e065571487fb5e4a8dcd5790f79)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:41.519474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:41.585799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:41.587491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:41.625344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bd19-90d5-4258-a874-dc7c39825bdf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:41.662549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:41.665854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:41.666217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:41.666756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] PATH_INFO: `/v3/users/0072a982066a4076833cfc2881b12693` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:41.676935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0072a982066a4076833cfc2881b12693)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:41.681811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:04:41.681811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 09:04:41.681811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: Jun 03 09:04:41.684049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:41.719806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42085e065571487fb5e4a8dcd5790f79'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.754571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42085e065571487fb5e4a8dcd5790f79'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.755333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42085e065571487fb5e4a8dcd5790f79'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.773389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42085e065571487fb5e4a8dcd5790f79'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.784128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42085e065571487fb5e4a8dcd5790f79'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.798036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 839/1668] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:41 2022] DELETE /identity/v3/users/42085e065571487fb5e4a8dcd5790f79 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:41.799113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:41.804636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:41.853455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0072a982066a4076833cfc2881b12693'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.880056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:41.898357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0072a982066a4076833cfc2881b12693'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.919059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0072a982066a4076833cfc2881b12693'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.921339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0072a982066a4076833cfc2881b12693'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.935205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0a10bd42-1da5-4617-b39e-5421c541c4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0072a982066a4076833cfc2881b12693'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:41.949847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 830/1669] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:41 2022] DELETE /identity/v3/users/0072a982066a4076833cfc2881b12693 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:41.952606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:41.953011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:41.953395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:41.956540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719daaa-5d7c-4bbc-9f02-e26271776196 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:42.020133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:42.025739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.143607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:42.145145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.145539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.145955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] PATH_INFO: `/v3/users/20f0b0b65d2243ef921c870ec24c745b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.148290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f0b0b65d2243ef921c870ec24c745b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:42.151848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:42.161548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:42.246373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f0b0b65d2243ef921c870ec24c745b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:42.298681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 831/1670] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:42.305443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f0b0b65d2243ef921c870ec24c745b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:42.307975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f0b0b65d2243ef921c870ec24c745b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:42.317835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:42.318583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.340120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f0b0b65d2243ef921c870ec24c745b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:42.358128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9e7f6ca3-c6de-4120-ba20-cfae894a561f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f0b0b65d2243ef921c870ec24c745b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:42.375673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 840/1671] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:41 2022] DELETE /identity/v3/users/20f0b0b65d2243ef921c870ec24c745b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:42.381003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2513-23a6-4b2f-bf07-5dbc21d49747 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.381416 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2513-23a6-4b2f-bf07-5dbc21d49747 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.381679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2513-23a6-4b2f-bf07-5dbc21d49747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.440796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dd0f2513-23a6-4b2f-bf07-5dbc21d49747 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:42.442051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dd0f2513-23a6-4b2f-bf07-5dbc21d49747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.496213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1128045-faf9-4238-81ec-4c7b880b8491 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:42.604797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:42.605688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.606117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.606652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.609503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.629754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 841/1672] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:42.652697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f714-d081-41e4-94aa-2213a9aa6cdf None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.652919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f714-d081-41e4-94aa-2213a9aa6cdf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.653032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f714-d081-41e4-94aa-2213a9aa6cdf None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.655380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 842/1673] 10.222.0.61 () {54 vars in 960 bytes} [Fri Jun 3 09:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:04:42.665380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.665672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.665971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.704929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:42.706181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.718496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:42.764841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:42.768434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:42.783569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 832/1674] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:42.825234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:42.828312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.869166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01dd1-6838-48dc-883b-d40bc966c7b8 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:42.877764 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 843/1675] 10.222.0.61 () {58 vars in 1057 bytes} [Fri Jun 3 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:42.887710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:42.897961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:42.898770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.899147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.900020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.909615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009734c-afe5-49b0-b591-6d12d1b76535 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:42.923532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:42.924248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:42.924554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:42.924821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:42.926718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:42.926835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:42.930019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:42.947969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:42.949609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f977397-91e8-4bcf-ab1d-d74b5e14db34 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:42.965445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 833/1676] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:04:42.997922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 844/1677] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:43.740208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:43.742846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:43.768050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edaab3-6cea-4b83-b09e-67cff1d98276 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:43.788098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:43.796102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:43.796931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:43.797741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] PATH_INFO: `/v3/projects/4d01b6216ece49e1bf3e55459077ce0d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:43.803320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d01b6216ece49e1bf3e55459077ce0d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:43.835846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:43.995871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d01b6216ece49e1bf3e55459077ce0d', 'request_id': 'req-c24a7b44-fe87-4ad4-9976-cfca89dee96e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.015956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d01b6216ece49e1bf3e55459077ce0d', 'request_id': 'req-c24a7b44-fe87-4ad4-9976-cfca89dee96e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.035834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d01b6216ece49e1bf3e55459077ce0d', 'request_id': 'req-c24a7b44-fe87-4ad4-9976-cfca89dee96e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.067585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] The token cache is being invalidate because project 4d01b6216ece49e1bf3e55459077ce0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:44.068073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.075475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c24a7b44-fe87-4ad4-9976-cfca89dee96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.083923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 834/1678] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:43 2022] DELETE /identity/v3/projects/4d01b6216ece49e1bf3e55459077ce0d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:44.085188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.085667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.086290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.110161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:44.138805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:44.145185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:44.319366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 845/1679] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:44.329505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4737-9b9d-4451-ab10-4a32e3689b2b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.330490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4737-9b9d-4451-ab10-4a32e3689b2b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.331187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4737-9b9d-4451-ab10-4a32e3689b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.395889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-40bd4737-9b9d-4451-ab10-4a32e3689b2b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:44.397133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-40bd4737-9b9d-4451-ab10-4a32e3689b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:44.418811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 835/1680] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:44.425501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:44.456430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.456789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.457169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.470886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8102-7ede-4561-9811-60c51cd26a3e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:44.486511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:44.486511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.486511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.486511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.487300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:44.487428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:44.491300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:44.500199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] MFA Rules not processed for user `4a7b71aa00454406ab83a4891a8a719e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:44.505109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:44.526725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 846/1681] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:44.532528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:44.535575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:44.568167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526617f3-bb00-46a6-ba0b-21df94dfa74d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:44.598791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:44.599943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.600278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.600610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] PATH_INFO: `/v3/projects/2cf3dca9396a42c9aeab870da78e3b73` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.605835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf3dca9396a42c9aeab870da78e3b73)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:44.608053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:44.733355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf3dca9396a42c9aeab870da78e3b73', 'request_id': 'req-d1ed1948-e972-4667-a1d4-466bf44e92d5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.747935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 836/1682] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:44.750195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:44.750321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf3dca9396a42c9aeab870da78e3b73', 'request_id': 'req-d1ed1948-e972-4667-a1d4-466bf44e92d5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.766479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf3dca9396a42c9aeab870da78e3b73', 'request_id': 'req-d1ed1948-e972-4667-a1d4-466bf44e92d5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.792067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] The token cache is being invalidate because project 2cf3dca9396a42c9aeab870da78e3b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:44.792657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.793539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:44.796276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 847/1683] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:44 2022] DELETE /identity/v3/projects/2cf3dca9396a42c9aeab870da78e3b73 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:44.799142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958eb73-56c8-414f-9f44-9fc16dafd0bd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:44.800545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:44.803817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:44.880402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:44.966276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed1948-e972-4667-a1d4-466bf44e92d5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:44.967278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:44.968004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.968285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.968559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.969266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:44.971233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:44.978155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:44.981226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:44.981226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:44.981226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] PATH_INFO: `/v3/users/54bff756f3414938a8ccb57834f4ff8a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:44.985666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bff756f3414938a8ccb57834f4ff8a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:44.990972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.036328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:45.036522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 837/1684] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:44 2022] POST /identity/v3/projects => generated 405 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:45.039236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.050167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:45.099087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bff756f3414938a8ccb57834f4ff8a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.152525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bff756f3414938a8ccb57834f4ff8a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.156980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bff756f3414938a8ccb57834f4ff8a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.159507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde25a5-43c7-4d12-b952-f54be8bd5a0c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.173291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:45.174215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.174558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.174788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] PATH_INFO: `/v3/projects/5a17189151294d619cfe62968c457c76` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.177646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a17189151294d619cfe62968c457c76)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:45.179621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.180396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bff756f3414938a8ccb57834f4ff8a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.198395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bff756f3414938a8ccb57834f4ff8a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.216128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 848/1685] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:44 2022] DELETE /identity/v3/users/54bff756f3414938a8ccb57834f4ff8a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:04:45.216128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.218018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:45.311057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a17189151294d619cfe62968c457c76', 'request_id': 'req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.328632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a17189151294d619cfe62968c457c76', 'request_id': 'req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.340593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a17189151294d619cfe62968c457c76', 'request_id': 'req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.375433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] The token cache is being invalidate because project 5a17189151294d619cfe62968c457c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:45.375433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.376163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30ba5254-5d22-4f2a-91ac-2ff9b182e9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:45.383545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 838/1686] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:45 2022] DELETE /identity/v3/projects/5a17189151294d619cfe62968c457c76 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:45.385645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b53c-5c13-4fd9-a289-52c18399d8ff None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.385938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b53c-5c13-4fd9-a289-52c18399d8ff None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.386434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b53c-5c13-4fd9-a289-52c18399d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.395054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544881d4-258c-4ff5-89d6-ff97ad72830c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.426907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-55a0b53c-5c13-4fd9-a289-52c18399d8ff None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:45.429244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-55a0b53c-5c13-4fd9-a289-52c18399d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:45.583308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:45.584164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.584548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.584941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.590034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:45.594397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.623624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 839/1687] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:45.631595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.631595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.631910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.646679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:45.665744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 849/1688] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:45 2022] POST /identity/v3/users => generated 303 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:45.667632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:45.670610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:45.671374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.680179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:45.713372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 840/1689] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:45.718213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.722877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1bca9-2c78-4989-a190-b742d829d6aa admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.737132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3a48-2523-4c19-93e4-1e03c4d78fb2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.748670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:45.752455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.752995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.753465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.754388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:45.759783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.775410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:45.776717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.777151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.777560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.778610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:45.779135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:45.781952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.800317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 841/1690] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:45.805278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 850/1691] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:45.805475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.809309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.833326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c378aa-52b5-4073-8078-cc593c933b16 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.840331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84208b-27f0-4be8-be65-2a5bd66e53c8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.842569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:45.843655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.844171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.844579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.845803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:45.848615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.860307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:45.861554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:45.861933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:45.865552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:45.866457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:45.880197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:45.912256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 851/1692] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:45.913345 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.923566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 842/1693] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:45 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:04:45.927791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:45.949406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4deba-5591-4ee3-9834-9ff5b05239a2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:45.993223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:46.152296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f2a54-a044-49e6-9761-fccba8f8df00 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:46.172249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:46.174433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:46.175463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:46.180916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:46.183179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:46.185745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:46.188097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:46.191087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:46.194992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:46.195701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] PATH_INFO: `/v3/projects/f90169d104a54a709a5a327b8522014c/users/99d02e511d4f48f4910f48e0c59ae9c1/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:46.233452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90169d104a54a709a5a327b8522014c, user_id=99d02e511d4f48f4910f48e0c59ae9c1, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:46.236378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:46.252993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 843/1694] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:45 2022] POST /identity/v3/users => generated 286 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:46.253934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:46.258690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:46.288993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 852/1695] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:45 2022] PUT /identity/v3/projects/f90169d104a54a709a5a327b8522014c/users/99d02e511d4f48f4910f48e0c59ae9c1/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:46.303542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:46.306503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d1edb-704a-43b3-8ead-d0b8d8f9cd15 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:46.505978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbba4e-ebdf-4950-9d53-d4c3122a7514 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:46.534052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:46.536109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:46.536394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:46.536676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] PATH_INFO: `/v3/projects/1739ee87e7ff4841880c8444ee34b6d7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:46.539572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1739ee87e7ff4841880c8444ee34b6d7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:46.541894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:46.543660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb965819-1631-47a9-bea4-55eae865ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:46.544573 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb965819-1631-47a9-bea4-55eae865ea7a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:46.549773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb965819-1631-47a9-bea4-55eae865ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:46.550278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb965819-1631-47a9-bea4-55eae865ea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:46.551226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb965819-1631-47a9-bea4-55eae865ea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:46.559983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb965819-1631-47a9-bea4-55eae865ea7a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:46.595525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 853/1696] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:46.609774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df3f62-275c-4a72-9f93-5164b98ad3e3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:46.610196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df3f62-275c-4a72-9f93-5164b98ad3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:46.610580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df3f62-275c-4a72-9f93-5164b98ad3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:46.707653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f9df3f62-275c-4a72-9f93-5164b98ad3e3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:46.711704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f9df3f62-275c-4a72-9f93-5164b98ad3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:46.734709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1739ee87e7ff4841880c8444ee34b6d7', 'request_id': 'req-3888488f-9382-4152-a29b-14f0ce63e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:46.751851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:46.773733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1739ee87e7ff4841880c8444ee34b6d7', 'request_id': 'req-3888488f-9382-4152-a29b-14f0ce63e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:46.807334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1739ee87e7ff4841880c8444ee34b6d7', 'request_id': 'req-3888488f-9382-4152-a29b-14f0ce63e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:46.847192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] The token cache is being invalidate because project 1739ee87e7ff4841880c8444ee34b6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:46.847734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:46.854729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:46.858528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 844/1697] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:46 2022] DELETE /identity/v3/projects/1739ee87e7ff4841880c8444ee34b6d7 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:46.859652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:46.865228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:46.992335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 854/1698] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:46.994065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf17d-4f13-434c-b594-ebe88fd50201 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:46.994615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf17d-4f13-434c-b594-ebe88fd50201 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:46.996119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf17d-4f13-434c-b594-ebe88fd50201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.047213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-01bbf17d-4f13-434c-b594-ebe88fd50201 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:47.048619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-01bbf17d-4f13-434c-b594-ebe88fd50201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:47.079137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 855/1699] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:47.079137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.079137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.079137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.124799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:47.125290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888488f-9382-4152-a29b-14f0ce63e857 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.126176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:47.152608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693b931-3e8f-484c-b525-e1227ddc6f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.153316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b931-3e8f-484c-b525-e1227ddc6f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.153598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b931-3e8f-484c-b525-e1227ddc6f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.153874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b931-3e8f-484c-b525-e1227ddc6f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.154615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b931-3e8f-484c-b525-e1227ddc6f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.165893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:47.170510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b931-3e8f-484c-b525-e1227ddc6f3d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.200443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 845/1700] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:47.200443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.200443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.200443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.228477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 856/1701] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:47.229800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.232719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:47.239284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:47.243007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:47.270082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 846/1702] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:47.270931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.294247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832765d-d238-4960-8d92-24592df2bec7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.312040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.313011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.313291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.313563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] PATH_INFO: `/v3/projects/1af485b7a2534654a0b9d41b767a2ad1/users/ea22fa9dba2e4bcc9dcdf088698ca56d/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.345596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af485b7a2534654a0b9d41b767a2ad1, user_id=ea22fa9dba2e4bcc9dcdf088698ca56d, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.348367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.369734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee29ab4-08df-4d57-80e0-01b6e592e7fd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.376750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 847/1703] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:47 2022] PUT /identity/v3/projects/1af485b7a2534654a0b9d41b767a2ad1/users/ea22fa9dba2e4bcc9dcdf088698ca56d/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:47.386691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.452755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889fc9-4cea-4b7d-8de1-28a5604272cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.453424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889fc9-4cea-4b7d-8de1-28a5604272cb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.453705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889fc9-4cea-4b7d-8de1-28a5604272cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.453976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889fc9-4cea-4b7d-8de1-28a5604272cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.534642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889fc9-4cea-4b7d-8de1-28a5604272cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.536176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889fc9-4cea-4b7d-8de1-28a5604272cb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.546106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6825-510c-40ca-9f6e-b624d25c4dc7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.549708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 857/1704] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:47.551028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.551479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.551792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.557134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.557937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.558218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.558493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.559237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:47.559547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.561773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.599783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] MFA Rules not processed for user `ea22fa9dba2e4bcc9dcdf088698ca56d`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:47.602033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:47.610656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 848/1705] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:47.613568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.616716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:47.642985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:47.714314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 858/1706] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:47.715321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.723601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:47.730078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b46b-49e5-41e9-805d-b7b0fceec5d0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.737990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.740132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.740520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.741180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.741967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.744739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.778566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00733de5-8400-4a81-aa62-3efa231abd95 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.789822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.790596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.791804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.792120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.797207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 859/1707] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:47.798280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.903953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada501-ba8e-4fb2-bb0c-ab3fd50fd1f8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:47.910149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:47.910895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:47.911188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:47.911473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:47.912347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.914734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.953114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 860/1708] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:47.954354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:47.961439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:47.964060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:47.988860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 849/1709] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:04:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:04:47.989885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.013543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7536-515e-45a0-9cac-d78118785877 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.129401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46bee-9c02-49ca-8cdb-938366a95858 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.154442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.159357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.161569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.162723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.164356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.177407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.253774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.254531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.254814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.259533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.260353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.271266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.285932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 861/1710] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:48.293555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.333064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669fc08-8e8a-4c66-87c9-97c873f1b948 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.349143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.350631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.351106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.351494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.353114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.356049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.373213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 850/1711] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:47 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:48.376933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 862/1712] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:48.381320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.382599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.398326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253638b8-d69e-464b-8228-e930b23d9441 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.407809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.409095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.410751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.411294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.413768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.417307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.420135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:48.440621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d88f-7bca-4251-98e1-86ccb8ceca91 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.454366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.460137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.460137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.460137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.460137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.460137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.491581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 863/1713] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:04:48.507341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.515174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 851/1714] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:48.516317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.544181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79291-28d4-4633-a2a0-48d23ce12e72 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.556768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc33a-0321-4f1b-b467-c73827744c47 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.562942 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266d803-5d18-46c1-88d8-633358036ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.571082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266d803-5d18-46c1-88d8-633358036ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.572067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266d803-5d18-46c1-88d8-633358036ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.573346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266d803-5d18-46c1-88d8-633358036ca4 admin admin] PATH_INFO: `/v3/projects/a83b59e037384902bb6d27dcfbb9fdfa/users/a9815e41c7e74bba875c06329c845404/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.579706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.580710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.580999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.581275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] PATH_INFO: `/v3/projects/c23686d4a4c043b19018b44e511d632d/users/07844d49f35740ba8d7869958f76aeba/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.602084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266d803-5d18-46c1-88d8-633358036ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83b59e037384902bb6d27dcfbb9fdfa, user_id=a9815e41c7e74bba875c06329c845404, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.612385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266d803-5d18-46c1-88d8-633358036ca4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.648329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23686d4a4c043b19018b44e511d632d, user_id=07844d49f35740ba8d7869958f76aeba, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:48.653050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:48.657541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 864/1715] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:48 2022] PUT /identity/v3/projects/a83b59e037384902bb6d27dcfbb9fdfa/users/a9815e41c7e74bba875c06329c845404/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:48.660533 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.660882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:48.661274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:48.709012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 852/1716] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:48 2022] PUT /identity/v3/projects/c23686d4a4c043b19018b44e511d632d/users/07844d49f35740ba8d7869958f76aeba/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:48.709279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] MFA Rules not processed for user `a9815e41c7e74bba875c06329c845404`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:48.710993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:48.713508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.832135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 865/1717] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:48.834436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:48.953775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:48.969863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a5e6b-1b55-4ab6-a7b6-28be09dddcdd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:48.983644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:48.997918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:48.999660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.000586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.002674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:49.010657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:49.032674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749e05-fbb3-47b1-85c2-686c50b723ed admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:49.055555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:49.058404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.058829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.060811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.061789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:49.078842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:49.120518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 866/1718] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:48 2022] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:49.120955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:49.123589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 853/1719] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:49.124763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:49.180920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37b372-0590-4f51-a6ea-ec2f2b8198f4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:49.316343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:49.346108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a1bc-e7eb-4728-a935-c8b04a5cc9ba admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:49.354594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:49.355205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.355496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.355798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.356503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:49.376527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:49.481187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 867/1720] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:49 2022] POST /identity/v3/users => generated 300 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:49.483844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:49.507262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:49.511486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.512419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.520084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] PATH_INFO: `/v3/projects/c23686d4a4c043b19018b44e511d632d/users/07844d49f35740ba8d7869958f76aeba/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.530334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23686d4a4c043b19018b44e511d632d, user_id=07844d49f35740ba8d7869958f76aeba, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:49.538698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:49.582230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602d90e-cf5c-4a93-bd9f-eff3b9e0596a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:49.609064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d2a9-7806-496a-be11-d24aa8cd03c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:49.609757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d2a9-7806-496a-be11-d24aa8cd03c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.610044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d2a9-7806-496a-be11-d24aa8cd03c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.610548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d2a9-7806-496a-be11-d24aa8cd03c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.611176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d2a9-7806-496a-be11-d24aa8cd03c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:49.618420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d2a9-7806-496a-be11-d24aa8cd03c7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:49.636464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 854/1721] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:49 2022] PUT /identity/v3/projects/c23686d4a4c043b19018b44e511d632d/users/07844d49f35740ba8d7869958f76aeba/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:49.638117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:49.641687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:49.672015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 868/1722] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:49.673474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e98a-57a0-4e97-ba0a-926a5d2dc7f2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.677562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e98a-57a0-4e97-ba0a-926a5d2dc7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.677937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e98a-57a0-4e97-ba0a-926a5d2dc7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.735876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-78b5e98a-57a0-4e97-ba0a-926a5d2dc7f2 None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:49.739321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-78b5e98a-57a0-4e97-ba0a-926a5d2dc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:49.874266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75f39b-bc0d-4095-ae04-f82e46e21dda admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:49.881718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:49.882400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.883111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.883465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] PATH_INFO: `/v3/users/aaf749068e63460b9678d0e50a946fa7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.886710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf749068e63460b9678d0e50a946fa7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:49.888988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:49.913768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 869/1723] 10.222.0.66 () {58 vars in 1015 bytes} [Fri Jun 3 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:49.915475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:49.916078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:49.916888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:49.989420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] MFA Rules not processed for user `07844d49f35740ba8d7869958f76aeba`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:49.991866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:50.009985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf749068e63460b9678d0e50a946fa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:50.047934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf749068e63460b9678d0e50a946fa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:50.058107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:50.064688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf749068e63460b9678d0e50a946fa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:50.071313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf749068e63460b9678d0e50a946fa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:50.083575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf749068e63460b9678d0e50a946fa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:50.101336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 855/1724] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:49 2022] DELETE /identity/v3/users/aaf749068e63460b9678d0e50a946fa7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:50.102452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:50.107351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:50.215865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 870/1725] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:50.222792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:50.227429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:50.275187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53a6a2-78f2-4b7b-aa77-b4db0d38b35a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:50.294520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db6782-8353-4fcf-b01b-13cfdcbc02f0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:50.307268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dfd08-decd-4375-9def-366129a00df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:50.309085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dfd08-decd-4375-9def-366129a00df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:50.309416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dfd08-decd-4375-9def-366129a00df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:50.309706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dfd08-decd-4375-9def-366129a00df8 admin admin] PATH_INFO: `/v3/projects/4faf5990c43d4048ba836dec538a2731/users/ac6165abdda04862b28e3e9f5b702d48/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:50.363496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dfd08-decd-4375-9def-366129a00df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4faf5990c43d4048ba836dec538a2731, user_id=ac6165abdda04862b28e3e9f5b702d48, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:50.377096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dfd08-decd-4375-9def-366129a00df8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:50.427635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 856/1726] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:50 2022] PUT /identity/v3/projects/4faf5990c43d4048ba836dec538a2731/users/ac6165abdda04862b28e3e9f5b702d48/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:50.432421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:50.434052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:50.434561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:50.489924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:50.493707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:50.494711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:50.495011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:50.502596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:50.504316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:50.506153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:50.558225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:50.560072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:50.596681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 871/1727] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:50.601815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:50.607573 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:50.631874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:50.800652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd4b91-502e-487d-a1af-34aac06bf02b service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:50.811058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 857/1728] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:50.812144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:50.838820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b500d-d8bd-4ca6-a349-924838836f41 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:50.864403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:50.865556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:50.867407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:50.869418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:50.881121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:50.898184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:50.943175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:50.944205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:50.944656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:50.945347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:50.945540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 858/1729] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:50.951706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:51.103512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:51.106426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:51.205863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505ba73-edbe-492b-afb0-d01ccb986ef2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:51.232770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f512-c6cc-431d-9c86-e43337ca0242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:51.242971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f512-c6cc-431d-9c86-e43337ca0242 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:51.249950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 872/1730] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:51.254644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:51.257391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f512-c6cc-431d-9c86-e43337ca0242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:51.257644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f512-c6cc-431d-9c86-e43337ca0242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:51.304382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9d71-0723-4861-a1ba-70ae86d3c2f5 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:51.332599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f512-c6cc-431d-9c86-e43337ca0242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:51.336076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f512-c6cc-431d-9c86-e43337ca0242 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:51.336267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8493ea7-6b53-42c2-90e1-70b8005b3c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:51.340894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8493ea7-6b53-42c2-90e1-70b8005b3c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:51.344884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8493ea7-6b53-42c2-90e1-70b8005b3c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:51.345356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8493ea7-6b53-42c2-90e1-70b8005b3c4e admin admin] PATH_INFO: `/v3/projects/4faf5990c43d4048ba836dec538a2731/users/ac6165abdda04862b28e3e9f5b702d48/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:51.350957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8493ea7-6b53-42c2-90e1-70b8005b3c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4faf5990c43d4048ba836dec538a2731, user_id=ac6165abdda04862b28e3e9f5b702d48, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:51.363703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8493ea7-6b53-42c2-90e1-70b8005b3c4e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:51.380690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 859/1731] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:51.385429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1d2e7-22ef-4b2c-895a-0cfb44a7e069 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:51.388064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1d2e7-22ef-4b2c-895a-0cfb44a7e069 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:51.388402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1d2e7-22ef-4b2c-895a-0cfb44a7e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:51.415949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 873/1732] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:51 2022] PUT /identity/v3/projects/4faf5990c43d4048ba836dec538a2731/users/ac6165abdda04862b28e3e9f5b702d48/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:51.430401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:51.430829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:51.431191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:51.434540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:51.534291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dab1d2e7-22ef-4b2c-895a-0cfb44a7e069 None None] MFA Rules not processed for user `22457f943fb84f0794695a132f93a3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:51.535887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dab1d2e7-22ef-4b2c-895a-0cfb44a7e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:51.541820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] MFA Rules not processed for user `ac6165abdda04862b28e3e9f5b702d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:51.546884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:51.756474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:51.801928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 860/1733] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:51.822465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:51.828256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:51.828543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:51.860667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 874/1734] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:51.862251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:51.867197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:51.900713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] MFA Rules not processed for user `99d02e511d4f48f4910f48e0c59ae9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:51.902134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:52.092814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f50d8-f013-4f72-8da8-9317c3cd80e0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:52.109139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:52.110347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:52.112757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:52.114039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:52.136366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:52.140044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:52.194006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 875/1735] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:52.197015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:52.247689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 861/1736] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:52.266109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:52.270907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:52.452984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace549-6450-4868-9936-7e0df037ce0c service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:52.469375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:52.470058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:52.470341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:52.470855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:52.530276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:52.532085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:52.575250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879113-9c80-4239-8f40-ca028d785e03 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:52.594719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 876/1737] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:52.602064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:52.604197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:52.606193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:52.606659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:52.612968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:52.613878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:52.616585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:52.628373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:52.680037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6784c-446d-4cdc-915a-b54a85cd3fef service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:52.699417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:52.700400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:52.700705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:52.700981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] PATH_INFO: `/v3/users/ea22fa9dba2e4bcc9dcdf088698ca56d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:52.703336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea22fa9dba2e4bcc9dcdf088698ca56d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:52.707019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:52.727583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 862/1738] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:52 2022] POST /identity/v3/projects => generated 405 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:52.736708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:52.783109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:52.855364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea22fa9dba2e4bcc9dcdf088698ca56d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:52.905916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:52.922642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea22fa9dba2e4bcc9dcdf088698ca56d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:52.924056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea22fa9dba2e4bcc9dcdf088698ca56d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:52.957781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea22fa9dba2e4bcc9dcdf088698ca56d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:52.995566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31b8dc94-5fde-4302-be80-ad94ff910985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea22fa9dba2e4bcc9dcdf088698ca56d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:53.024867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 877/1739] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:52 2022] DELETE /identity/v3/users/ea22fa9dba2e4bcc9dcdf088698ca56d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:53.029506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:53.032802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:53.033392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:53.083584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:53.084827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:53.087565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d759d-cf63-4db0-97b3-58cc4053eaf3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:53.214817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 878/1740] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:53.243004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:53.253236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:53.298151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1ebe2-9157-479d-9025-374cbab85cd2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:53.321844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:53.324153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:53.324153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:53.324426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] PATH_INFO: `/v3/users/a9815e41c7e74bba875c06329c845404` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:53.334313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9815e41c7e74bba875c06329c845404)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:53.340139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:53.372655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:53.380347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:53.381003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:53.381442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:53.382353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:53.385498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:53.452712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 863/1741] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:52 2022] POST /identity/v3/users => generated 309 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:53.461171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:53.465461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:53.485749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9815e41c7e74bba875c06329c845404'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:53.537880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9815e41c7e74bba875c06329c845404'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:53.540362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9815e41c7e74bba875c06329c845404'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:53.564002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9815e41c7e74bba875c06329c845404'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:53.581919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9815e41c7e74bba875c06329c845404'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:53.604694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 879/1742] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:53 2022] DELETE /identity/v3/users/a9815e41c7e74bba875c06329c845404 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:53.606517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:53.611908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:53.681319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434579-cd8f-4490-af0b-c7cf1698ff58 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:53.824975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:53.859349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36153509-7bcd-4d38-b254-94dd07788b66 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:53.875680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:53.876945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:53.880643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:53.882174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:53.883193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ab02-d748-402f-aeab-5c71cc506c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:53.885127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ab02-d748-402f-aeab-5c71cc506c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:53.885843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ab02-d748-402f-aeab-5c71cc506c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:53.886419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ab02-d748-402f-aeab-5c71cc506c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:53.891170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:53.892470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ab02-d748-402f-aeab-5c71cc506c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:53.895733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ab02-d748-402f-aeab-5c71cc506c02 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:53.940552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 880/1743] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:53.941610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:53.943387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:53.945012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:53.952907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:53.953446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:53.983225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 864/1744] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:53.985220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:53.991141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:54.010378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:54.013523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03288bb8-167c-4b02-b407-518e789d9114 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:54.013799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:54.029372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710afd-bddd-4792-9007-149f7b00ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:54.031574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710afd-bddd-4792-9007-149f7b00ef1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.032175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710afd-bddd-4792-9007-149f7b00ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.032657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710afd-bddd-4792-9007-149f7b00ef1b admin admin] PATH_INFO: `/v3/projects/106f7fcdf42f466bab7297f93e1709fa/users/e175c6c8835b48aaa6c9eaeff46e4991/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.033705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 881/1745] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:54.055572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710afd-bddd-4792-9007-149f7b00ef1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=106f7fcdf42f466bab7297f93e1709fa, user_id=e175c6c8835b48aaa6c9eaeff46e4991, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:54.059513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710afd-bddd-4792-9007-149f7b00ef1b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:54.081038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 865/1746] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:53 2022] PUT /identity/v3/projects/106f7fcdf42f466bab7297f93e1709fa/users/e175c6c8835b48aaa6c9eaeff46e4991/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:54.085008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:54.098286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa572a70-a2f3-4a23-bbd1-16e80d41eb51 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:54.281759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a2eb-5eec-4766-a766-91105010aef8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.282434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a2eb-5eec-4766-a766-91105010aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.282434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a2eb-5eec-4766-a766-91105010aef8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.283711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 866/1747] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 09:04:54.298131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a2eb-5eec-4766-a766-91105010aef8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:54.300889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ffc1a2eb-5eec-4766-a766-91105010aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:54.303970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97525a71-2a7e-4b35-b7ec-e7febcc3a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:54.304748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97525a71-2a7e-4b35-b7ec-e7febcc3a1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.305258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97525a71-2a7e-4b35-b7ec-e7febcc3a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.305258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97525a71-2a7e-4b35-b7ec-e7febcc3a1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.305950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97525a71-2a7e-4b35-b7ec-e7febcc3a1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:54.307601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97525a71-2a7e-4b35-b7ec-e7febcc3a1c6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:54.336525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 882/1748] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:54.336525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.336525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.336525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.389944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:54.391370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:54.516256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a2eb-5eec-4766-a766-91105010aef8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:54.526982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:54.527689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.528073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.528403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.559945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:54.562127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:54.595672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 867/1749] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:04:54.596890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:54.602888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 883/1750] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:04:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:54.628108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d60f-8b2e-4abd-90aa-dd1f82236666 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:54.644636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:54.645574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.645882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.646896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] PATH_INFO: `/v3/projects/106f7fcdf42f466bab7297f93e1709fa/users/e175c6c8835b48aaa6c9eaeff46e4991/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.650592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106f7fcdf42f466bab7297f93e1709fa, user_id=e175c6c8835b48aaa6c9eaeff46e4991, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:54.652770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:54.655041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:54.660536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:54.686686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 868/1751] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:54 2022] PUT /identity/v3/projects/106f7fcdf42f466bab7297f93e1709fa/users/e175c6c8835b48aaa6c9eaeff46e4991/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:54.712593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939f6b9-0c63-43aa-acee-cc841ded05fa None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:54.921599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:54.922423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:54.922825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:54.923212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:54.945671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:54.948461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:54.950442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:54.996494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 884/1752] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:04:55.856741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:55.858740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:56.023936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abfdc1-6fb2-4fa3-94cc-5f46be67c417 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:56.046190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:56.048256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:56.058443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:56.060077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] PATH_INFO: `/v3/projects/94ca27045de94ea29fc11f7ee5f4174b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:56.066414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ca27045de94ea29fc11f7ee5f4174b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:56.080857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:56.157128 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:56.158819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:56.193261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a2f2-f6e8-4e32-a476-8b96a4faf2ad service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:56.197701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ca27045de94ea29fc11f7ee5f4174b', 'request_id': 'req-9c653c0e-ab01-4746-a722-be72f0139437'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.213223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ca27045de94ea29fc11f7ee5f4174b', 'request_id': 'req-9c653c0e-ab01-4746-a722-be72f0139437'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.233613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ca27045de94ea29fc11f7ee5f4174b', 'request_id': 'req-9c653c0e-ab01-4746-a722-be72f0139437'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.257006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:56.287873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] The token cache is being invalidate because project 94ca27045de94ea29fc11f7ee5f4174b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:56.288195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.296948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c653c0e-ab01-4746-a722-be72f0139437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.300210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 869/1753] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:55 2022] DELETE /identity/v3/projects/94ca27045de94ea29fc11f7ee5f4174b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:56.305326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45129f3-ca55-4f69-8df3-13f9d1a7ba28 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:56.305789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45129f3-ca55-4f69-8df3-13f9d1a7ba28 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:56.305897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45129f3-ca55-4f69-8df3-13f9d1a7ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:56.360634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:56.361647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:56.361994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:56.362620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] PATH_INFO: `/v3/projects/1af485b7a2534654a0b9d41b767a2ad1` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:56.366795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af485b7a2534654a0b9d41b767a2ad1)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:56.369067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:56.372402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a45129f3-ca55-4f69-8df3-13f9d1a7ba28 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:56.373697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a45129f3-ca55-4f69-8df3-13f9d1a7ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:56.406142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 870/1754] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:56.412940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:56.414460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:56.414756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:56.480517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:56.481725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:56.521118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 871/1755] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:56.523330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:56.546661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054dae0-da25-42ee-b5e0-76d9feb07ca2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:56.604793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af485b7a2534654a0b9d41b767a2ad1', 'request_id': 'req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.625671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af485b7a2534654a0b9d41b767a2ad1', 'request_id': 'req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.645440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af485b7a2534654a0b9d41b767a2ad1', 'request_id': 'req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.681692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] The token cache is being invalidate because project 1af485b7a2534654a0b9d41b767a2ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:56.685124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.687191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:56.695952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 885/1756] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:56 2022] DELETE /identity/v3/projects/1af485b7a2534654a0b9d41b767a2ad1 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:56.701940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:56.729155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:56.770586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:56.771468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:56.771987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:56.772500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:56.786160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:04:56.786690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:56.788664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:56.850240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 872/1757] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:04:56.855589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:56.858130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:56.901051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2afcc5-1f94-4207-b573-9ad35162b860 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:56.925147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:56.925836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:56.926127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:56.926406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:56.927111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:56.929144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:56.997115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4223f7-62b4-4e2c-b26f-694d904ef7ee admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:57.014496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:57.015431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:57.018328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:57.019233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] PATH_INFO: `/v3/users/07844d49f35740ba8d7869958f76aeba` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:57.023257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07844d49f35740ba8d7869958f76aeba)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:57.036021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:57.036112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 873/1758] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:56 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:57.036558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:57.109510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:57.180756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07844d49f35740ba8d7869958f76aeba'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:57.214193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07844d49f35740ba8d7869958f76aeba'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:57.215577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07844d49f35740ba8d7869958f76aeba'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:57.250788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07844d49f35740ba8d7869958f76aeba'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:57.261597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c269b4-b6ca-4566-9280-45777b6903f0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:57.268550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07844d49f35740ba8d7869958f76aeba'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:57.278761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:57.280796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:57.281741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:57.282748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:57.283682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:57.286453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 886/1759] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:56 2022] DELETE /identity/v3/users/07844d49f35740ba8d7869958f76aeba => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:57.288625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:57.318594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 874/1760] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:57 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:57.323029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:57.327110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:57.455896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59d22d-6e7a-478f-b082-513187e8b406 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:57.471404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:57.473638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:57.474243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:57.475018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:57.476373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:57.479521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:57.501583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 887/1761] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:57.505993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:57.560421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31939-7879-4830-9ef0-c4bfed981585 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:57.575957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f4c2-d102-4b4b-ab6c-7c66891fa9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:57.578223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f4c2-d102-4b4b-ab6c-7c66891fa9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:57.579192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f4c2-d102-4b4b-ab6c-7c66891fa9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:57.580116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f4c2-d102-4b4b-ab6c-7c66891fa9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:57.582993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f4c2-d102-4b4b-ab6c-7c66891fa9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:57.588574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f4c2-d102-4b4b-ab6c-7c66891fa9fa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:57.627564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 875/1762] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:57.630831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:57.647510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10b60-9f00-471c-a110-b9818997e39e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:57.684305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:57.685766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:57.686209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:57.686703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] PATH_INFO: `/v3/projects/e231d688eabe463a8e927de9b63006bd/users/9b2ce8d6365e43bc82834df96d294e86/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:57.728440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e231d688eabe463a8e927de9b63006bd, user_id=9b2ce8d6365e43bc82834df96d294e86, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:57.734388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:57.761992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 888/1763] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:57 2022] PUT /identity/v3/projects/e231d688eabe463a8e927de9b63006bd/users/9b2ce8d6365e43bc82834df96d294e86/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:04:57.773805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:57.774037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:57.774381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:57.804673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:57.806706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:57.858317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] MFA Rules not processed for user `9b2ce8d6365e43bc82834df96d294e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:57.859641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:57.930269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:58.042393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169054f-633f-4216-846b-5c21fa96b2b8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:58.055672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:58.056780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:58.057244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:58.058276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] PATH_INFO: `/v3/projects/a83b59e037384902bb6d27dcfbb9fdfa` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:58.059772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83b59e037384902bb6d27dcfbb9fdfa)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:58.062442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:58.114780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 876/1764] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:04:58.114780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:58.116968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:58.156291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc45967-66c2-4620-9556-39cd07f7ea81 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:58.174021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:58.174885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:58.175163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:58.184910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:58.189282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:58.193280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:58.219300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83b59e037384902bb6d27dcfbb9fdfa', 'request_id': 'req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.239521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83b59e037384902bb6d27dcfbb9fdfa', 'request_id': 'req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.272327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83b59e037384902bb6d27dcfbb9fdfa', 'request_id': 'req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.275937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 877/1765] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:04:58 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:58.282302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:58.313359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] The token cache is being invalidate because project a83b59e037384902bb6d27dcfbb9fdfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:04:58.315041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.317320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.325449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 889/1766] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:57 2022] DELETE /identity/v3/projects/a83b59e037384902bb6d27dcfbb9fdfa => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:58.326654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:58.328616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:58.484942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620740e-66a6-454f-ac09-a0bdee194540 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:58.508301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:58.511129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:58.511429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:58.511716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:58.512483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:58.523137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:58.569712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4d0d-646a-41b5-b3bc-9b4fd43ebfb7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:58.590107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 878/1767] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:04:58 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:04:58.596744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:58.600151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:58.600350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:58.601931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:58.601931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:58.601931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] PATH_INFO: `/v3/users/ac6165abdda04862b28e3e9f5b702d48` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:58.604503 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6165abdda04862b28e3e9f5b702d48)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:58.612425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:58.680447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b576-1925-48ac-99c3-1f50a50fca0b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:58.705259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:58.710761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:58.711826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:58.712122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:58.715196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:58.721688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:58.768630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 879/1768] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:04:58.769656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:58.798404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6165abdda04862b28e3e9f5b702d48'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.812911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c190a3a-bf7c-40e9-bbee-e5cfd5a60ba0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:58.832565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:58.833487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:58.833769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:58.834043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] PATH_INFO: `/v3/projects/5b59d3ac2aae448dba8a0eb7ae3ce679/users/1d85838f1a294ddeb257ec5ed7140953/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:58.837653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6165abdda04862b28e3e9f5b702d48'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.839944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6165abdda04862b28e3e9f5b702d48'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.857265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6165abdda04862b28e3e9f5b702d48'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.875738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b59d3ac2aae448dba8a0eb7ae3ce679, user_id=1d85838f1a294ddeb257ec5ed7140953, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:58.877973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6165abdda04862b28e3e9f5b702d48'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:04:58.887988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:58.894107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 890/1769] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:04:58 2022] DELETE /identity/v3/users/ac6165abdda04862b28e3e9f5b702d48 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:58.931826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 880/1770] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:58 2022] PUT /identity/v3/projects/5b59d3ac2aae448dba8a0eb7ae3ce679/users/1d85838f1a294ddeb257ec5ed7140953/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:04:58.933663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:58.935261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:59.037153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:59.132082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee4e8-df4a-40d0-844b-cdbd5ccc0a79 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:59.282652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78e1f4-f2a3-4541-9266-81c092f72f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:59.287074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e1f4-f2a3-4541-9266-81c092f72f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:59.287386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e1f4-f2a3-4541-9266-81c092f72f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:59.287725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e1f4-f2a3-4541-9266-81c092f72f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:59.289348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78e1f4-f2a3-4541-9266-81c092f72f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:59.291999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78e1f4-f2a3-4541-9266-81c092f72f24 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:59.350648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:59.366840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 891/1771] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:04:59.369481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0dd2-b5dd-4847-bdae-3048c756d975 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:04:59.383331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:04:59.383873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:59.384294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:59.384585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] PATH_INFO: `/v3/projects/5b59d3ac2aae448dba8a0eb7ae3ce679/users/1d85838f1a294ddeb257ec5ed7140953/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:59.392471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b59d3ac2aae448dba8a0eb7ae3ce679, user_id=1d85838f1a294ddeb257ec5ed7140953, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:04:59.395838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:04:59.437425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 881/1772] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:04:59 2022] PUT /identity/v3/projects/5b59d3ac2aae448dba8a0eb7ae3ce679/users/1d85838f1a294ddeb257ec5ed7140953/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:04:59.439187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:04:59.439552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:04:59.439885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:04:59.493214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] MFA Rules not processed for user `1d85838f1a294ddeb257ec5ed7140953`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:04:59.494739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:59.688208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 892/1773] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:04:59.699452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:59.703364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:59.811327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:04:59.817482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:04:59.970626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:04:59.995290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:00.011744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d607-b8f2-4a1e-a5a4-5bca6d265961 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:00.017187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81c728-624c-4f22-b46f-13f296b5fa88 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:00.021352 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:00.022296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.022588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.023093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:00.030341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:00.031256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.031613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.032117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] PATH_INFO: `/v3/projects/c23686d4a4c043b19018b44e511d632d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:00.037633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23686d4a4c043b19018b44e511d632d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:00.039871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:00.053846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:00.055815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:00.094902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 882/1774] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:04:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:00.181517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23686d4a4c043b19018b44e511d632d', 'request_id': 'req-9d26df48-f0db-4f0d-9955-25455e3eafc7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:00.196453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23686d4a4c043b19018b44e511d632d', 'request_id': 'req-9d26df48-f0db-4f0d-9955-25455e3eafc7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:00.223921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23686d4a4c043b19018b44e511d632d', 'request_id': 'req-9d26df48-f0db-4f0d-9955-25455e3eafc7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:00.228021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:00.241626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687869-3841-4bba-a853-0aa533e08ef9 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:00.243107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] The token cache is being invalidate because project c23686d4a4c043b19018b44e511d632d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:00.243717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:00.244805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d26df48-f0db-4f0d-9955-25455e3eafc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:00.248105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 893/1775] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:04:59 2022] DELETE /identity/v3/projects/c23686d4a4c043b19018b44e511d632d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:00.253739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc842-caf3-4c77-b34b-c7586f22ed63 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.255317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc842-caf3-4c77-b34b-c7586f22ed63 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.256582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc842-caf3-4c77-b34b-c7586f22ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:00.359596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3bfcc842-caf3-4c77-b34b-c7586f22ed63 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:00.371269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:00.372534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.372900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.373295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:00.375837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:00.378018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3bfcc842-caf3-4c77-b34b-c7586f22ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:00.510675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:00.515894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065d19-7159-4cce-8b39-9f3c37892a51 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:00.543575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 883/1776] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:00.721663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.722043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.722354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:00.731382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 894/1777] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:00.739059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.739351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.739704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:00.778776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] MFA Rules not processed for user `22457f943fb84f0794695a132f93a3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:00.784325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:00.834468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:00.839999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:00.886763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 895/1778] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:00.891493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:00.896428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:00.940826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d86f-8554-4323-bc92-328b30f421d9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:00.975174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:00.998746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:00.999097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:00.999468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] PATH_INFO: `/v3/projects/4faf5990c43d4048ba836dec538a2731` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.010413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4faf5990c43d4048ba836dec538a2731)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.014878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.051938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 884/1779] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:01.051938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.105257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8c79-f71f-4ada-96ba-a6682f5a56cb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.178344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4faf5990c43d4048ba836dec538a2731', 'request_id': 'req-ec4b43d6-c84d-41a1-b496-b708c470e14f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.204145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4faf5990c43d4048ba836dec538a2731', 'request_id': 'req-ec4b43d6-c84d-41a1-b496-b708c470e14f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.225062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4faf5990c43d4048ba836dec538a2731', 'request_id': 'req-ec4b43d6-c84d-41a1-b496-b708c470e14f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.263430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:01.295277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.296003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.297768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.298215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.301844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:01.302271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.303103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] The token cache is being invalidate because project 4faf5990c43d4048ba836dec538a2731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:01.305224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.305883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5b6e1-fb23-4063-935d-17439b7cda9e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.307950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ec4b43d6-c84d-41a1-b496-b708c470e14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.315565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 896/1780] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:00 2022] DELETE /identity/v3/projects/4faf5990c43d4048ba836dec538a2731 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:01.319238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.319827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.321776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 885/1781] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:01.322117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.323114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.323409 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.323693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.338368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:01.345109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:01.346492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.363652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 886/1782] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:01.364553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.368701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.389228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b853a5-16a5-49a0-a35f-78aec19ffa13 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.398406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051b2f-a6d1-46a7-ae7e-409f8bf5517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.399083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051b2f-a6d1-46a7-ae7e-409f8bf5517c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.399486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051b2f-a6d1-46a7-ae7e-409f8bf5517c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.399877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051b2f-a6d1-46a7-ae7e-409f8bf5517c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.400711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051b2f-a6d1-46a7-ae7e-409f8bf5517c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.403301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051b2f-a6d1-46a7-ae7e-409f8bf5517c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.409086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] MFA Rules not processed for user `e175c6c8835b48aaa6c9eaeff46e4991`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:01.413466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.463589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 887/1783] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:01.467893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.468187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.468465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.494964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:01.496270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.607443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 888/1784] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:01.608655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.610829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.617612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 897/1785] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:01.618451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.629273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff9b3-6b0f-4c98-9bb7-bc18bdf3d5f4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.635050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04910-bf41-49ca-8420-77ab1fac2130 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.635736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.636961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.637449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.637946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] PATH_INFO: `/v3/users/8a18e0fb03154970b39f9d1db624d4fa` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.639909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a18e0fb03154970b39f9d1db624d4fa)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.641801 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.642491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.642609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.642776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.643053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.643746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.645725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.682757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 898/1786] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/users => generated 290 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:01.690982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.702811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa60c-4ccc-47b7-add4-3e832d4b1a3e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.709175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.709175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.709175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.709516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.710453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:01.710641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.712510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.721708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a18e0fb03154970b39f9d1db624d4fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.727349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 899/1787] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:01.729007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.741798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01050e-ded2-42c2-8ace-b48d6239fa43 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.744293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a18e0fb03154970b39f9d1db624d4fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.753883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.754771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.754892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.755104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.756226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.757451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.760563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a18e0fb03154970b39f9d1db624d4fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.761981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a18e0fb03154970b39f9d1db624d4fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.778680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a18e0fb03154970b39f9d1db624d4fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:01.783633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 900/1788] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:01.783633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.788778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.797259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 889/1789] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:01 2022] DELETE /identity/v3/users/8a18e0fb03154970b39f9d1db624d4fa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:01.798217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.799586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.809120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24188152-eb48-43c8-91dd-f84b65fd7bcc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.832979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:01.891471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd860b0-d6c9-42f5-b688-cdf4551d6960 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:01.895214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ac353-3445-453a-a5d0-702177cdc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.896186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ac353-3445-453a-a5d0-702177cdc311 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.896748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ac353-3445-453a-a5d0-702177cdc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.897071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2a48-fc01-4716-9ed7-28687d0d9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:01.897434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ac353-3445-453a-a5d0-702177cdc311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.897791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2a48-fc01-4716-9ed7-28687d0d9d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.898099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2a48-fc01-4716-9ed7-28687d0d9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.898381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2a48-fc01-4716-9ed7-28687d0d9d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.899008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ac353-3445-453a-a5d0-702177cdc311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.899124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2a48-fc01-4716-9ed7-28687d0d9d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:01.900867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2a48-fc01-4716-9ed7-28687d0d9d41 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.901495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ac353-3445-453a-a5d0-702177cdc311 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:01.915073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 890/1790] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:01.917758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.918297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.918521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.937323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 901/1791] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:01.938658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273e455-790f-45bb-b301-dc0cea19dadd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:01.939599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273e455-790f-45bb-b301-dc0cea19dadd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:01.939916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273e455-790f-45bb-b301-dc0cea19dadd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:01.941446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 902/1792] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 09:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:05:01.942014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273e455-790f-45bb-b301-dc0cea19dadd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:01.942122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:01.943427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:01.983196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:02.029271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273e455-790f-45bb-b301-dc0cea19dadd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.034835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b9227-4194-44e2-8f22-c7bba8cc81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.035957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b9227-4194-44e2-8f22-c7bba8cc81d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.036405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b9227-4194-44e2-8f22-c7bba8cc81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.036827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b9227-4194-44e2-8f22-c7bba8cc81d6 admin admin] PATH_INFO: `/v3/projects/9192df3abbca43f0a315e92b09282f94/users/59c576cd1e654efc8685eb4392b7b7c6/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.038287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 891/1793] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:02.043443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.055747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d0c5-04ce-49dc-b545-943f0039c8a1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.065496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.066866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.068030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.068588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.070533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.074923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b9227-4194-44e2-8f22-c7bba8cc81d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9192df3abbca43f0a315e92b09282f94, user_id=59c576cd1e654efc8685eb4392b7b7c6, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.077096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.078313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b9227-4194-44e2-8f22-c7bba8cc81d6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.101954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 903/1794] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:01 2022] PUT /identity/v3/projects/9192df3abbca43f0a315e92b09282f94/users/59c576cd1e654efc8685eb4392b7b7c6/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:02.103285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367f85c-02f1-4c1a-b2a0-d67883d40bb2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.103586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367f85c-02f1-4c1a-b2a0-d67883d40bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.104112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367f85c-02f1-4c1a-b2a0-d67883d40bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.116215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 892/1795] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/users => generated 293 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:02.118080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.119140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:02.130170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3367f85c-02f1-4c1a-b2a0-d67883d40bb2 None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:02.131795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3367f85c-02f1-4c1a-b2a0-d67883d40bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:02.193585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 904/1796] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:02.195245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.196181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.196542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.201952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a28c79-2c06-4061-89a1-3584c5bb4096 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.208657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.209340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.209626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.209907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.232087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] MFA Rules not processed for user `59c576cd1e654efc8685eb4392b7b7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:02.233318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:02.306039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:02.316444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.320591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.336219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 893/1797] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:02.340771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.353801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947461d-8f25-41ee-b47b-a889df32ccbd service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.358348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 905/1798] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:02.364505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.365206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.365581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.365903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.366693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.370714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.372335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.390880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be299d-5003-45ae-a092-280decbbfa08 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.392417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 894/1799] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:02.394564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.399401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.400102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.400385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.400657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.409415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29363f7-ce57-4e78-ab36-10ad9f2a1d7e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.413783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.414579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.415310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.415586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.415717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.415892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.416999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.419860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.427662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 906/1800] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:02.431588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.454503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 895/1801] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:02.457751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337447-2006-409c-953c-87900fc8f6ea service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.458594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.512425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:02.549286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.549609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0af220-29cd-4d3d-a612-1ed6bac72c05 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.550497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.550835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.551183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.552036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.554469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.558860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.559553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.559870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.560152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.561526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.569984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.580600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 907/1802] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:02.585249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.597170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477598-24b2-4727-b7f1-952c6dcacce4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.597393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 896/1803] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:02.598626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.602334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4d7d-a78d-4270-abd4-27b2ac3a44dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.603315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4d7d-a78d-4270-abd4-27b2ac3a44dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.603666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4d7d-a78d-4270-abd4-27b2ac3a44dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.604045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4d7d-a78d-4270-abd4-27b2ac3a44dc admin admin] PATH_INFO: `/v3/projects/cccdcfb76c0445e399da793f1a968803/users/f4afac34b1eb48f7be2dbe5499a320b4/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.610561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4309b-baa4-45e6-b082-a301b381d720 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.615314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.616091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.616408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.616655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.617339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.619084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.622354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce4d7d-a78d-4270-abd4-27b2ac3a44dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccdcfb76c0445e399da793f1a968803, user_id=f4afac34b1eb48f7be2dbe5499a320b4, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.626406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce4d7d-a78d-4270-abd4-27b2ac3a44dc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.630446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 897/1804] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:02.634520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.651922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 908/1805] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:02 2022] PUT /identity/v3/projects/cccdcfb76c0445e399da793f1a968803/users/f4afac34b1eb48f7be2dbe5499a320b4/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:02.652120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f3ac-b70a-4ec9-9432-d877844df222 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.655105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.655601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.655973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.686477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] MFA Rules not processed for user `f4afac34b1eb48f7be2dbe5499a320b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:02.687571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:02.727252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.728593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.729312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.729912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.730720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.733060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.750326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 898/1806] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:02.751451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.761558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c1e2-1fde-4dd2-8cfa-e309cea51d9c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.761735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 909/1807] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:02.766162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.766624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7a993-9003-4554-a898-acf47cdff81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.767535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7a993-9003-4554-a898-acf47cdff81c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.767901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7a993-9003-4554-a898-acf47cdff81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.768182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7a993-9003-4554-a898-acf47cdff81c admin admin] PATH_INFO: `/v3/projects/3b51a44c0601477b855f210dea0d0755/users/96f110dd736f44ecbecc2a17028f519c/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.778312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b79efd-adc1-41a4-a921-db273f353b49 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.785369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.786146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.786438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.787203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.788126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.790708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.792392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7a993-9003-4554-a898-acf47cdff81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b51a44c0601477b855f210dea0d0755, user_id=96f110dd736f44ecbecc2a17028f519c, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.796983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7a993-9003-4554-a898-acf47cdff81c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.814142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 899/1808] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:02 2022] PUT /identity/v3/projects/3b51a44c0601477b855f210dea0d0755/users/96f110dd736f44ecbecc2a17028f519c/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:02.820709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 910/1809] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:02.827804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.829589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b1a8-eff2-4cf7-aa0f-ed96d930d8f7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.830059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b1a8-eff2-4cf7-aa0f-ed96d930d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.830491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b1a8-eff2-4cf7-aa0f-ed96d930d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.850883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:02.886157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6f25b1a8-eff2-4cf7-aa0f-ed96d930d8f7 None None] MFA Rules not processed for user `96f110dd736f44ecbecc2a17028f519c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:02.887913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6f25b1a8-eff2-4cf7-aa0f-ed96d930d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:02.908785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10b9e-68f7-4ae5-9d51-bef9b96623f8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.915106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.916697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.917388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.917388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.918253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.921078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.946827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 911/1810] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:02.950518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.965355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d287-64ca-4940-a0e9-b92948047fd3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:02.971454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:02.972260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.972554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.972837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.973867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:02.976131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:02.981630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 900/1811] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:02.981823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:02.981909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eb5c5-71e9-41cf-bc28-c9bfc97a9411 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:02.981909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eb5c5-71e9-41cf-bc28-c9bfc97a9411 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:02.981909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eb5c5-71e9-41cf-bc28-c9bfc97a9411 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:02.982122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 901/1812] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:05:02.983492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eb5c5-71e9-41cf-bc28-c9bfc97a9411 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:02.999221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 912/1813] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:03.001432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.005145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eb5c5-71e9-41cf-bc28-c9bfc97a9411 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.013460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4851cba-5b5f-4ff6-85a0-aa946903e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.016535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4851cba-5b5f-4ff6-85a0-aa946903e45c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.017013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4851cba-5b5f-4ff6-85a0-aa946903e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.017486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4851cba-5b5f-4ff6-85a0-aa946903e45c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.018971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4851cba-5b5f-4ff6-85a0-aa946903e45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.022375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809ef3-9e1a-4e2a-abae-bd85c76a3edb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.023377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4851cba-5b5f-4ff6-85a0-aa946903e45c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.040588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.042979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.043496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.044036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] PATH_INFO: `/v3/projects/c944d6499f9f49d59bd295e61de6b005/users/9cc19d730f4345dda1b07dc77a38ed9f/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.069525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944d6499f9f49d59bd295e61de6b005, user_id=9cc19d730f4345dda1b07dc77a38ed9f, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.073913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.098192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 902/1814] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:02 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:03.110092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.110448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.110736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.110909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 913/1815] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:02 2022] PUT /identity/v3/projects/c944d6499f9f49d59bd295e61de6b005/users/9cc19d730f4345dda1b07dc77a38ed9f/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:03.112189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.153624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:03.157850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:03.241640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f2e7-0446-47e1-974b-fb4b64b28487 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.283307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 903/1816] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:03.285634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.322940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.324109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.324918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.325429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.327011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.329977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.359899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 914/1817] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:03 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:03.360987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.364487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:03.381469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327db33-4ec5-4504-ae68-8546b1b2259e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.387087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.388583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.389223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.389707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.400946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.403601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.412246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7c1dc-5656-409c-8dc0-c934e5eeeda5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.415954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 915/1818] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:03.418944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.434570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3947262-337c-4be7-8855-d9311cf36e3c service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.437913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.442651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.443962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.444575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.445055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.446016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.447950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.448326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.448855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.449337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.450691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.453305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.462354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 916/1819] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:03.469145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.480616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 904/1820] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:03.484635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5328-2cb8-4211-bfe2-4d8ae790a09b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.484964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.496341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.497452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.497999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.498500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] PATH_INFO: `/v3/projects/1a1b9e952b4e4370a909257690cbdf7a/users/437364418439431bbbd73639941343c6/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.499558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4a868-a4e5-4439-81ed-bb2d1e0b19d4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.506070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef3a06-a2d2-4d66-a7a1-8e81aab33f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.507207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3a06-a2d2-4d66-a7a1-8e81aab33f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.507856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3a06-a2d2-4d66-a7a1-8e81aab33f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.508345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3a06-a2d2-4d66-a7a1-8e81aab33f99 admin admin] PATH_INFO: `/v3/projects/c944d6499f9f49d59bd295e61de6b005/users/9cc19d730f4345dda1b07dc77a38ed9f/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.510580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef3a06-a2d2-4d66-a7a1-8e81aab33f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944d6499f9f49d59bd295e61de6b005, user_id=9cc19d730f4345dda1b07dc77a38ed9f, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.514682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef3a06-a2d2-4d66-a7a1-8e81aab33f99 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.524643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:03.528274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1b9e952b4e4370a909257690cbdf7a, user_id=437364418439431bbbd73639941343c6, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.533308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.547526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 905/1821] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:03 2022] PUT /identity/v3/projects/c944d6499f9f49d59bd295e61de6b005/users/9cc19d730f4345dda1b07dc77a38ed9f/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:03.550386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.550698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.551388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.572654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 917/1822] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:03 2022] PUT /identity/v3/projects/1a1b9e952b4e4370a909257690cbdf7a/users/437364418439431bbbd73639941343c6/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:03.573939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.606194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:03.651899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62294a2-d9ac-4816-af4d-0b0a1ec01880 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.657753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.658413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.658773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.659125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.659951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.661650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.666586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] MFA Rules not processed for user `9cc19d730f4345dda1b07dc77a38ed9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:03.667026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:03.677673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 918/1823] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:03.678658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.689814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236ab8-281e-4377-9a1f-96617c762370 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.694894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939c9d3-6fa1-48d1-b073-2e9253e1c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:03.695881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939c9d3-6fa1-48d1-b073-2e9253e1c668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.696193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939c9d3-6fa1-48d1-b073-2e9253e1c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.696474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939c9d3-6fa1-48d1-b073-2e9253e1c668 admin admin] PATH_INFO: `/v3/projects/1a1b9e952b4e4370a909257690cbdf7a/users/437364418439431bbbd73639941343c6/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.698672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939c9d3-6fa1-48d1-b073-2e9253e1c668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1b9e952b4e4370a909257690cbdf7a, user_id=437364418439431bbbd73639941343c6, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:03.701990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939c9d3-6fa1-48d1-b073-2e9253e1c668 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:03.729268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 919/1824] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:03 2022] PUT /identity/v3/projects/1a1b9e952b4e4370a909257690cbdf7a/users/437364418439431bbbd73639941343c6/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:03.739553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:03.739888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:03.740166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:03.778797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] MFA Rules not processed for user `437364418439431bbbd73639941343c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:03.781016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:03.792717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 906/1825] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:03.806535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:03.808432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:03.913246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88124a73-f2c1-4e5c-b9ac-ce4a2a9a256b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:03.993250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 920/1826] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:04.035485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:04.036672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.037132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.037429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.063296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:04.066891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.138252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:04.159974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:04.162083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:04.188263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 907/1827] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:04.189563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:04.191712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.195144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0e774-efa6-4026-9dba-5186158394e0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:04.204201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:04.205088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.205368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.207800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] PATH_INFO: `/v3/projects/6be943ae107a44b3b2dc7d2f4b488a45` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.210373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be943ae107a44b3b2dc7d2f4b488a45)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:04.216546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b9c5b-ba04-4990-a31a-be4871dcf135 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:04.216769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:04.221180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:04.222203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.222673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.223053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.248814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:04.251793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:04.280354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 908/1828] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:04.324362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:04.325233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:04.343070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6abc7-f559-4702-92ba-d847f2c032ef service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:04.348474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be943ae107a44b3b2dc7d2f4b488a45', 'request_id': 'req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.364518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be943ae107a44b3b2dc7d2f4b488a45', 'request_id': 'req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.379935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be943ae107a44b3b2dc7d2f4b488a45', 'request_id': 'req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.403329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] The token cache is being invalidate because project 6be943ae107a44b3b2dc7d2f4b488a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:04.405973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.408342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.413419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 921/1829] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:04 2022] DELETE /identity/v3/projects/6be943ae107a44b3b2dc7d2f4b488a45 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:04.418175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:04.420709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.446050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:04.446726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.447007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.447283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.452127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.556806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:04.560111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086def8-4ea4-4469-ada0-4b3e562fa022 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:04.576887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ec5a-6ba6-4b4d-bfe6-6160ab9027b0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:04.583543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:04.584478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.584759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.584881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 909/1830] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:04.585056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] PATH_INFO: `/v3/users/c4863e3906954fb5b48ca6af1dec83eb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.586293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462186-d8af-4a74-b10b-dd7beffb51b8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.586412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4863e3906954fb5b48ca6af1dec83eb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:04.586630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462186-d8af-4a74-b10b-dd7beffb51b8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.586876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462186-d8af-4a74-b10b-dd7beffb51b8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.588433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:04.588550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 910/1831] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:05:04.599864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.600419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.600778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.636883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] MFA Rules not processed for user `1c78bee52575447ca8f4e1bf2c7a3c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:04.638357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.680301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4863e3906954fb5b48ca6af1dec83eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.700493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4863e3906954fb5b48ca6af1dec83eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.701444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4863e3906954fb5b48ca6af1dec83eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.720711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4863e3906954fb5b48ca6af1dec83eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.739457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4863e3906954fb5b48ca6af1dec83eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.744853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 911/1832] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:04.746143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:04.749578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.765666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20fc2-6efb-4fa6-aec0-afe513dca1e4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:04.766557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 922/1833] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:04 2022] DELETE /identity/v3/users/c4863e3906954fb5b48ca6af1dec83eb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:04.769403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:04.779049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:04.801507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:04.850398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:04.851504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:04.851981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:04.854496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] PATH_INFO: `/v3/users/99d02e511d4f48f4910f48e0c59ae9c1` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:04.856531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d02e511d4f48f4910f48e0c59ae9c1)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:04.861265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:04.919050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:04.944361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d02e511d4f48f4910f48e0c59ae9c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.988990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab604c4a-57d4-4e45-abbb-e38208981510 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:04.992497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d02e511d4f48f4910f48e0c59ae9c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:04.998788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.000171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.001115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.001539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.009436 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d02e511d4f48f4910f48e0c59ae9c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.011542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d02e511d4f48f4910f48e0c59ae9c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.033245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d02e511d4f48f4910f48e0c59ae9c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.039635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.046575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 912/1834] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:04 2022] DELETE /identity/v3/users/99d02e511d4f48f4910f48e0c59ae9c1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:05.047656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.099339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 923/1835] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:05.354071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.354776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.355657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.356381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.379981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67445-1dd0-4a8b-a3e2-0980881b9c8d service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.457685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.458674 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.459033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.459379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] PATH_INFO: `/v3/projects/e8dbf91ff1794367a2fc390e6ad541ce` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.460929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dbf91ff1794367a2fc390e6ad541ce)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.463027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.463353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f7115-5942-44fe-9397-8c89464b6d57 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.468533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.469428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.469710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.469985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] PATH_INFO: `/v3/users/f4afac34b1eb48f7be2dbe5499a320b4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.471204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4afac34b1eb48f7be2dbe5499a320b4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.473360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.523127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dbf91ff1794367a2fc390e6ad541ce', 'request_id': 'req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.530062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4afac34b1eb48f7be2dbe5499a320b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.530560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dbf91ff1794367a2fc390e6ad541ce', 'request_id': 'req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.531281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:05.542358 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dbf91ff1794367a2fc390e6ad541ce', 'request_id': 'req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.549153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4afac34b1eb48f7be2dbe5499a320b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.555457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] The token cache is being invalidate because project e8dbf91ff1794367a2fc390e6ad541ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:05.555748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.556450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.558308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 924/1836] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:05 2022] DELETE /identity/v3/projects/e8dbf91ff1794367a2fc390e6ad541ce => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:05.558776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.560041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.565657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4afac34b1eb48f7be2dbe5499a320b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.567143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4afac34b1eb48f7be2dbe5499a320b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.579189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a1278fa4-1844-4311-ac0a-6a3b5d2bb620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4afac34b1eb48f7be2dbe5499a320b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.588211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 913/1837] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:05 2022] DELETE /identity/v3/users/f4afac34b1eb48f7be2dbe5499a320b4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:05.593779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50699ab-5fb4-485b-a7a2-17944f8ace70 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.594091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50699ab-5fb4-485b-a7a2-17944f8ace70 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.594889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50699ab-5fb4-485b-a7a2-17944f8ace70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.617468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a50699ab-5fb4-485b-a7a2-17944f8ace70 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:05.618917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a50699ab-5fb4-485b-a7a2-17944f8ace70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.635010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae118e07-4a87-4e00-b612-8f8a0d1fddcf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.639540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:05.687534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 914/1838] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:05.688973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a61d59-2f9c-4426-b30b-fc5f21895f8e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.689340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a61d59-2f9c-4426-b30b-fc5f21895f8e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.689687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a61d59-2f9c-4426-b30b-fc5f21895f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.696242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.697727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.698038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.698310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] PATH_INFO: `/v3/projects/f90169d104a54a709a5a327b8522014c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.699517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90169d104a54a709a5a327b8522014c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.701763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.707554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-60a61d59-2f9c-4426-b30b-fc5f21895f8e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:05.708810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-60a61d59-2f9c-4426-b30b-fc5f21895f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.716539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 915/1839] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:05.719929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.719929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.719929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.738590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:05.739842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.753559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90169d104a54a709a5a327b8522014c', 'request_id': 'req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.760164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90169d104a54a709a5a327b8522014c', 'request_id': 'req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.769013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90169d104a54a709a5a327b8522014c', 'request_id': 'req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.780752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] The token cache is being invalidate because project f90169d104a54a709a5a327b8522014c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:05.781116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.781972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.784031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 925/1840] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:05 2022] DELETE /identity/v3/projects/f90169d104a54a709a5a327b8522014c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:05.784917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.786597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.805224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 916/1841] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:05.806155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.807802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.819980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211011-889a-4dbe-8380-7e88f8f39aad None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.825610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.826542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.826984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.827266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] PATH_INFO: `/v3/users/e175c6c8835b48aaa6c9eaeff46e4991` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.828511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e175c6c8835b48aaa6c9eaeff46e4991)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.830476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.846819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc6288-3215-48bb-aa0a-e53974f0e3d6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.850455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.851100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.851379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.851651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.853499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.868016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.869395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.880144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 926/1842] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:05.880321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e175c6c8835b48aaa6c9eaeff46e4991'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.880797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.885464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:05.892287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778ea0-788d-4bdf-a4a1-9839d58f7afc service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.895331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e175c6c8835b48aaa6c9eaeff46e4991'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.898912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:05.899583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:05.899906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:05.900169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:05.900892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:05.901204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:05.902806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:05.904761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e175c6c8835b48aaa6c9eaeff46e4991'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.905515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e175c6c8835b48aaa6c9eaeff46e4991'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.914861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e175c6c8835b48aaa6c9eaeff46e4991'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:05.918737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 927/1843] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:05.922785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:05.922979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 917/1844] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:05 2022] DELETE /identity/v3/users/e175c6c8835b48aaa6c9eaeff46e4991 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:05.928904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:05.946662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476531-4b01-4c44-91d9-e60b02658f29 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:05.992299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:06.041500 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.042325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.042746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.043080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.043824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.046883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.079745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 928/1845] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:05 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:06.080892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.091190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf3a5-84bb-42f3-940a-86eb613f70a4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.170462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.171156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.171441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.171724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.172465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.174434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.193955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.195871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.203834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 918/1846] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:06.205786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.212407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484b66-36cc-4c96-a2d5-a182a3532525 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.218239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.219188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebc588-3fa2-4cdf-8a10-ff1247fa92b0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.219292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.219476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.219775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] PATH_INFO: `/v3/projects/106f7fcdf42f466bab7297f93e1709fa` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.220997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=106f7fcdf42f466bab7297f93e1709fa)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.222938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.224889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.225621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.225916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.226238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.226999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.229745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.242260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 919/1847] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:06.246944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.266210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655f60-d368-4d0f-ab58-26bd53d27b05 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.281016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.282268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.282891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.283472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.284471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.286768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.315705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 920/1848] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:06.316743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.318554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106f7fcdf42f466bab7297f93e1709fa', 'request_id': 'req-72715686-e438-408c-998a-81c0f61504bf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.321459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.331305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106f7fcdf42f466bab7297f93e1709fa', 'request_id': 'req-72715686-e438-408c-998a-81c0f61504bf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.355286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106f7fcdf42f466bab7297f93e1709fa', 'request_id': 'req-72715686-e438-408c-998a-81c0f61504bf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.370989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63cc42-9dc9-4321-8713-c0e1c5a49cde admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.371499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] The token cache is being invalidate because project 106f7fcdf42f466bab7297f93e1709fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:06.371736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.373116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.378044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 929/1849] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:06 2022] DELETE /identity/v3/projects/106f7fcdf42f466bab7297f93e1709fa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:06.378044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.379269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.441998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.443430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.444070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.444440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] PATH_INFO: `/v3/projects/cccdcfb76c0445e399da793f1a968803` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.447138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccdcfb76c0445e399da793f1a968803)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.450038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.453372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72715686-e438-408c-998a-81c0f61504bf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.458956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050838-4043-4114-a1b1-d4d248ee3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.459953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050838-4043-4114-a1b1-d4d248ee3269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.460242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050838-4043-4114-a1b1-d4d248ee3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.461178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050838-4043-4114-a1b1-d4d248ee3269 admin admin] PATH_INFO: `/v3/projects/2450da4e5b334e918d867b4a0e105206/users/b969bd96d8b34909b10d3640f078d38a/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.477109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f050838-4043-4114-a1b1-d4d248ee3269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2450da4e5b334e918d867b4a0e105206, user_id=b969bd96d8b34909b10d3640f078d38a, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.480461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f050838-4043-4114-a1b1-d4d248ee3269 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.493777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 930/1850] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:06 2022] PUT /identity/v3/projects/2450da4e5b334e918d867b4a0e105206/users/b969bd96d8b34909b10d3640f078d38a/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:06.495159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.495426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.495712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.505651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:06.512832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccdcfb76c0445e399da793f1a968803', 'request_id': 'req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.514732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:06.516218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.521157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccdcfb76c0445e399da793f1a968803', 'request_id': 'req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.527504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccdcfb76c0445e399da793f1a968803', 'request_id': 'req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.528691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:06.541953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] The token cache is being invalidate because project cccdcfb76c0445e399da793f1a968803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:06.542247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.542889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6b5c54c0-fe5e-4652-9559-0ed5e7c96898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.544594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 921/1851] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:06 2022] DELETE /identity/v3/projects/cccdcfb76c0445e399da793f1a968803 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:06.545865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8bf8-2e75-4b00-bb69-bf722bfcca0f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.546155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8bf8-2e75-4b00-bb69-bf722bfcca0f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.546430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8bf8-2e75-4b00-bb69-bf722bfcca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.572783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-76ad8bf8-2e75-4b00-bb69-bf722bfcca0f None None] MFA Rules not processed for user `b969bd96d8b34909b10d3640f078d38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:06.574004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-76ad8bf8-2e75-4b00-bb69-bf722bfcca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.581588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 931/1852] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:06.582630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.584006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.596810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f5fc6-5532-46b9-8031-8700bcb84055 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.601580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.602454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.602871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.603153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] PATH_INFO: `/v3/users/9cc19d730f4345dda1b07dc77a38ed9f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.604400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc19d730f4345dda1b07dc77a38ed9f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.606350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.656663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 922/1853] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:06.656663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.656663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.656663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.664349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc19d730f4345dda1b07dc77a38ed9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.675095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:06.676457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.678013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc19d730f4345dda1b07dc77a38ed9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.678829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc19d730f4345dda1b07dc77a38ed9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.685631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 923/1854] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:06.686258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.687521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:06.691461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc19d730f4345dda1b07dc77a38ed9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.699912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc19d730f4345dda1b07dc77a38ed9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:06.700238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c978dc-e404-4e54-a614-4a7b7c93ff16 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.706448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.707374 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.707488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 932/1855] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:06 2022] DELETE /identity/v3/users/9cc19d730f4345dda1b07dc77a38ed9f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:06.707571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.707641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.708373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.710322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.710698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.753841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 924/1856] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:06.758690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.795948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325d7a1-c947-4ba4-92a2-3b69a1f070a2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.843874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:06.852520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218af87-3ae7-4c57-8ffc-01dd7ab870a8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.858369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.859127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.859475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.859742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.860571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.862915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.876321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.877001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.877321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.877620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.878498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:06.878813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.880583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.886918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 925/1857] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:06.891503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.895825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 933/1858] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:06.898049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.902410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c914f0b-cfae-46d4-a25b-904c71c91c6f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.907322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.908028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.908332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.908605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.909353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.910442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41db91d-df8a-4ecb-a6a2-dcf26b80ff34 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.913696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.920620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.921304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.921586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.921861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.922556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.924729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.925193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 926/1859] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:06.929637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.940434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d4ac-59e5-4482-a576-af6c1901f430 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:06.945737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:06.946457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:06.946768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:06.947090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] PATH_INFO: `/v3/projects/6614ec91f3554ab187469345f2d7dba1/users/3f1c49bffb744fcca10532c378ec9c97/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:06.952309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:06.959826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 934/1860] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:06.961583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:06.969294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6614ec91f3554ab187469345f2d7dba1, user_id=3f1c49bffb744fcca10532c378ec9c97, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:06.972596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:06.992279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 927/1861] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:06 2022] PUT /identity/v3/projects/6614ec91f3554ab187469345f2d7dba1/users/3f1c49bffb744fcca10532c378ec9c97/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:06.996486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.044962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f44c-e1fc-46d2-8b5a-1c41f377a3d3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.086396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fdce-39cb-4711-8dda-3b1fef421f79 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.092489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.093250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.093534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.093807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.094564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.096244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.111773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 928/1862] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:07.111773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.111773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.120087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.120775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.121062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.121340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.122038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.124705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.125186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fb330-01cc-47eb-bef9-95571c8dc359 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.129869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.130727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.131004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.131274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] PATH_INFO: `/v3/projects/c944d6499f9f49d59bd295e61de6b005` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.132469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c944d6499f9f49d59bd295e61de6b005)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.134383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.148659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 935/1863] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:06 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:07.149396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.159472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c95a9-b6c2-4c3b-a8ba-070f6e5ec2bc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.164410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.165220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.165530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.165836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] PATH_INFO: `/v3/projects/6614ec91f3554ab187469345f2d7dba1/users/3f1c49bffb744fcca10532c378ec9c97/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.168389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6614ec91f3554ab187469345f2d7dba1, user_id=3f1c49bffb744fcca10532c378ec9c97, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.171626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.183440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 936/1864] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:07 2022] PUT /identity/v3/projects/6614ec91f3554ab187469345f2d7dba1/users/3f1c49bffb744fcca10532c378ec9c97/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:07.184350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.187264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c944d6499f9f49d59bd295e61de6b005', 'request_id': 'req-f4b7de98-1b16-4726-b1c8-69f5d73b6976'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:07.194027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c944d6499f9f49d59bd295e61de6b005', 'request_id': 'req-f4b7de98-1b16-4726-b1c8-69f5d73b6976'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:07.201134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c944d6499f9f49d59bd295e61de6b005', 'request_id': 'req-f4b7de98-1b16-4726-b1c8-69f5d73b6976'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:07.214402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] The token cache is being invalidate because project c944d6499f9f49d59bd295e61de6b005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:07.214747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:07.215422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f4b7de98-1b16-4726-b1c8-69f5d73b6976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:07.217073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 929/1865] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:07 2022] DELETE /identity/v3/projects/c944d6499f9f49d59bd295e61de6b005 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:07.218378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dfdf4-c5cb-4b72-8383-2f5c88bb3134 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.218667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dfdf4-c5cb-4b72-8383-2f5c88bb3134 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.218942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dfdf4-c5cb-4b72-8383-2f5c88bb3134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.224597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:07.247319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e70dfdf4-c5cb-4b72-8383-2f5c88bb3134 None None] MFA Rules not processed for user `3f1c49bffb744fcca10532c378ec9c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:07.249127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e70dfdf4-c5cb-4b72-8383-2f5c88bb3134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.256809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa537-5479-4729-91f0-8843838186bc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.261857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84967ef-cb5d-4ada-b5d8-2195b03c26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.262227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84967ef-cb5d-4ada-b5d8-2195b03c26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.262634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84967ef-cb5d-4ada-b5d8-2195b03c26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.262785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84967ef-cb5d-4ada-b5d8-2195b03c26d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.263621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84967ef-cb5d-4ada-b5d8-2195b03c26d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.265353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84967ef-cb5d-4ada-b5d8-2195b03c26d5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.276504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 937/1866] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:07.277868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.278155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.278427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.298526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:07.299732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.306108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:07.315656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 938/1867] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:07.315656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.315656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.323620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27137571-2302-48bc-b0d9-64cfa06cc818 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.328696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.329364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.329651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.329922 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.330682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.332344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.334599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 930/1868] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:07.335916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.336199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.336471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.346600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 939/1869] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:07.347439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.349147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.355640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:07.356841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.366685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 931/1870] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:07.368459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.380233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67397-1aff-4574-adbe-a710bd3879c6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.385718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.386699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.387088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.387434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] PATH_INFO: `/v3/projects/35492461ae054cdf96c98fc4761bd4e6/users/fa069ea646bd4d0fbbea0da5c85a2079/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.404458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35492461ae054cdf96c98fc4761bd4e6, user_id=fa069ea646bd4d0fbbea0da5c85a2079, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.407313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.411033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dd204-e4b7-4f16-a511-3765d8ea12b2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.415570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e3f14-5a71-4ee9-a3b2-bf42af31260d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.416578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e3f14-5a71-4ee9-a3b2-bf42af31260d service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.416882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e3f14-5a71-4ee9-a3b2-bf42af31260d service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.417182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e3f14-5a71-4ee9-a3b2-bf42af31260d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.426564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 932/1871] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:07 2022] PUT /identity/v3/projects/35492461ae054cdf96c98fc4761bd4e6/users/fa069ea646bd4d0fbbea0da5c85a2079/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:07.427489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.439132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e3f14-5a71-4ee9-a3b2-bf42af31260d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.440619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e3f14-5a71-4ee9-a3b2-bf42af31260d service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.453701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 940/1872] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:07.455145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.455504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.456341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.489959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] MFA Rules not processed for user `fa069ea646bd4d0fbbea0da5c85a2079`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:07.491175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:07.551288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142408-3014-45a3-a9cd-9ba7c3e04687 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.564581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.565989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.566849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.567804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.572166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:07.572569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.574318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.591331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 941/1873] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:07.595166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.597392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 933/1874] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:07.598500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.609534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901398-94bd-4a72-a081-f97e9f20f141 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.612859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cde8b-cbee-43fc-9d7b-d9968ccaddda admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.615633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.616708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.617477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.617969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.618760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.618946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.619291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.619566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.620099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.620806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.622980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.627805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.664479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 934/1875] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:07.664479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.667794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 942/1876] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:07.671905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.710938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:07.746068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca180-f089-47c1-bc38-6f7b2d121bd6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.773808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77395-a125-4054-90c4-7bdc2e309b8d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.781619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.782446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.783071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.783858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.784741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.787028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.816406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:07.821768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 943/1877] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:07.826895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.845228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4eaa0-4417-4085-a652-374b9cdd17c6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.852637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.853335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.853622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.853908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.854701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.857825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.875960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 944/1878] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:07.882616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.883620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.884347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.885024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.885316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.886018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.888149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.898619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8e44-e29c-41fa-b044-c22c72b08e68 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.903738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.904982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.905272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.905631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.906252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.907917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.925331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 945/1880] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:07.925485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 935/1880] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:07 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:07.928751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.928863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.939672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7391-860b-4e8a-8abe-ac9afa5f368c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.945201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.946039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.946330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.946615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.947350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:07.948177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d87c5-7662-4789-bd7e-a20b766914fe admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.949173 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:07.956271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fdca-6eb7-4fb4-931b-60680e198529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:07.957632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fdca-6eb7-4fb4-931b-60680e198529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:07.957956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fdca-6eb7-4fb4-931b-60680e198529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:07.958460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fdca-6eb7-4fb4-931b-60680e198529 admin admin] PATH_INFO: `/v3/projects/8fe184b994f94e8f82ff4ae8888efa1d/users/3639d0dbb3c847d499b16a749c9d5923/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:07.968974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 946/1881] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:07.973243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:07.992145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b1d24-55fb-4108-b5ab-2e11da974a80 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:07.999985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fdca-6eb7-4fb4-931b-60680e198529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe184b994f94e8f82ff4ae8888efa1d, user_id=3639d0dbb3c847d499b16a749c9d5923, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.000135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.000277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fdca-6eb7-4fb4-931b-60680e198529 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.000367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.000367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.000532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] PATH_INFO: `/v3/projects/5c86241d25ab43b8a0a68fe8d2aad90a/users/e2468532c9004527a0294c4312835381/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.019793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 936/1882] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:07 2022] PUT /identity/v3/projects/8fe184b994f94e8f82ff4ae8888efa1d/users/3639d0dbb3c847d499b16a749c9d5923/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:08.021975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c86241d25ab43b8a0a68fe8d2aad90a, user_id=e2468532c9004527a0294c4312835381, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.025876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.030728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.030728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.031017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.048396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 947/1883] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:07 2022] PUT /identity/v3/projects/5c86241d25ab43b8a0a68fe8d2aad90a/users/e2468532c9004527a0294c4312835381/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:08.061412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.065631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] MFA Rules not processed for user `3639d0dbb3c847d499b16a749c9d5923`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:08.067095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:08.147185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ff82-88c7-44c8-9457-3ed357e6b269 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.152845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.153786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.154136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.154906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.155785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.158000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.158766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 937/1884] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:08.159636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.171260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de76f9-a324-4b97-88b5-2f6f887bd697 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.172057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 948/1885] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:08.176152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.176558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.177139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.177426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.177701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.178547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.180879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.189724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123447b-f1c4-445d-9a5f-3c7d3966661a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.194732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b877a97-6e17-4fb9-903b-2b72495d62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.195631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877a97-6e17-4fb9-903b-2b72495d62b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.196060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877a97-6e17-4fb9-903b-2b72495d62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.196223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877a97-6e17-4fb9-903b-2b72495d62b7 admin admin] PATH_INFO: `/v3/projects/5c86241d25ab43b8a0a68fe8d2aad90a/users/e2468532c9004527a0294c4312835381/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.198275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b877a97-6e17-4fb9-903b-2b72495d62b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c86241d25ab43b8a0a68fe8d2aad90a, user_id=e2468532c9004527a0294c4312835381, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.202321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b877a97-6e17-4fb9-903b-2b72495d62b7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.211310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 938/1886] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:08 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:08.215321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.223626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 949/1887] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:08 2022] PUT /identity/v3/projects/5c86241d25ab43b8a0a68fe8d2aad90a/users/e2468532c9004527a0294c4312835381/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:08.234200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.234492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.234769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.280015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] MFA Rules not processed for user `e2468532c9004527a0294c4312835381`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:08.281234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:08.305569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107119b-b392-4f29-9e48-2f663b6bc5d9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.313085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.313769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.314050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.314328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.314597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:08.315021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.317013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.335877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:08.346078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 939/1888] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:08 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:08.347489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.359370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33552-c2b8-4d4c-a6b2-dede689589ac admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.366229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.366906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.367192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.367467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.368238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.369855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.383083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 940/1889] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:08.390421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 950/1890] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:08.390558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.399483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.401085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:08.403549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520614-3670-4669-9c7f-51d11cb7237d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.410704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.411926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.412213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.412547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] PATH_INFO: `/v3/projects/98b307ead75548f595eaabfcb4c948f6/users/1173e8032bd54ed1a35fd67bfbe46e87/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.436457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b307ead75548f595eaabfcb4c948f6, user_id=1173e8032bd54ed1a35fd67bfbe46e87, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.439828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.463319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 941/1891] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:08 2022] PUT /identity/v3/projects/98b307ead75548f595eaabfcb4c948f6/users/1173e8032bd54ed1a35fd67bfbe46e87/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:08.470470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.475013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30840bf-f651-4a8b-918c-f6003d9474a0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.538061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32d694-264f-4f9e-b2ba-a141237e29a3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.540621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.541538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.541823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.542160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.543586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.544284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.544731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.545009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.545733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.547372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.561153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 942/1892] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:08.565148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.577196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca67c9-4663-4d99-a58f-adab3f5b62d2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.585315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c247-c4e9-4b18-86ab-b3f463291e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.588120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c247-c4e9-4b18-86ab-b3f463291e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.588300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c247-c4e9-4b18-86ab-b3f463291e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.588745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c247-c4e9-4b18-86ab-b3f463291e57 admin admin] PATH_INFO: `/v3/projects/98b307ead75548f595eaabfcb4c948f6/users/1173e8032bd54ed1a35fd67bfbe46e87/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.591265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c247-c4e9-4b18-86ab-b3f463291e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b307ead75548f595eaabfcb4c948f6, user_id=1173e8032bd54ed1a35fd67bfbe46e87, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.595199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c247-c4e9-4b18-86ab-b3f463291e57 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.615847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 943/1893] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:08 2022] PUT /identity/v3/projects/98b307ead75548f595eaabfcb4c948f6/users/1173e8032bd54ed1a35fd67bfbe46e87/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:08.619913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.620205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.620484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.625739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.627439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.640584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 951/1894] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:08.651632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] MFA Rules not processed for user `1173e8032bd54ed1a35fd67bfbe46e87`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:08.652908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:08.726763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.740996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e74dc9-4a15-4983-9c09-98c28b1f720c service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.749565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 944/1895] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:08.763262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:08.780837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:08.808294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:08.840957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.841758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.842851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.842851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] PATH_INFO: `/v3/users/fa069ea646bd4d0fbbea0da5c85a2079` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.844640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa069ea646bd4d0fbbea0da5c85a2079)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.846924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.847864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d64f-8f6e-4609-b2f9-bd6ed1e7b56a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:08.856502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:08.857997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:08.858287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:08.858566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:08.871491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:08.874309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:08.889395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 945/1896] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:08.939568 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa069ea646bd4d0fbbea0da5c85a2079'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:08.954060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa069ea646bd4d0fbbea0da5c85a2079'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:08.955007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa069ea646bd4d0fbbea0da5c85a2079'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:08.973018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa069ea646bd4d0fbbea0da5c85a2079'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:08.994395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4fca5489-8f95-4e8e-bf7a-880ddf0fbadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa069ea646bd4d0fbbea0da5c85a2079'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.004236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 952/1897] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:08 2022] DELETE /identity/v3/users/fa069ea646bd4d0fbbea0da5c85a2079 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:09.004854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.008681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.009246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.009705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.015204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cc11-a350-4b7d-9642-4ad49c79376a service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.032765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:09.034079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.087586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:09.088420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.088809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.089180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.091150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.182794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:09.183029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 953/1898] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:09.185178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:09.194979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.197322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 946/1899] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:09.198708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.280772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:09.285885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fae5ca-db1b-49f0-bbba-5a767f4ebdac None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.300903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f1d1d-b49d-433e-b3d8-5ed0fa439d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:09.301576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f1d1d-b49d-433e-b3d8-5ed0fa439d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.301864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f1d1d-b49d-433e-b3d8-5ed0fa439d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.302145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f1d1d-b49d-433e-b3d8-5ed0fa439d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.316242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f1d1d-b49d-433e-b3d8-5ed0fa439d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:09.318065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f1d1d-b49d-433e-b3d8-5ed0fa439d37 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:09.330514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 954/1900] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:09.355420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.356991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.374047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f377eb-8ed7-4a11-b124-df1498dd745d service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.379466 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:09.380458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.380797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.381225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] PATH_INFO: `/v3/users/b969bd96d8b34909b10d3640f078d38a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.382645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b969bd96d8b34909b10d3640f078d38a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:09.384850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:09.444846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b969bd96d8b34909b10d3640f078d38a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.460227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b969bd96d8b34909b10d3640f078d38a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.469529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b969bd96d8b34909b10d3640f078d38a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.470492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b969bd96d8b34909b10d3640f078d38a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.483535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b969bd96d8b34909b10d3640f078d38a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.492979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 947/1901] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:09 2022] DELETE /identity/v3/users/b969bd96d8b34909b10d3640f078d38a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:09.498037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.498465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.498612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.530336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.530479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:09.531576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.532333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.538586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:09.612663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 955/1902] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:09.618126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7535d8-73fe-4727-a65f-4914161ec844 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.623050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.624666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.626031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:09.626561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.626842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.627114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] PATH_INFO: `/v3/users/3639d0dbb3c847d499b16a749c9d5923` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.628382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3639d0dbb3c847d499b16a749c9d5923)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:09.630369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:09.694658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3639d0dbb3c847d499b16a749c9d5923'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.698213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9e36-554a-49aa-9b6a-e7b82c3aa6a7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.702694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:09.703363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.704020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.704020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.708561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3639d0dbb3c847d499b16a749c9d5923'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.714384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:09.715876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:09.715980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3639d0dbb3c847d499b16a749c9d5923'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.717272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3639d0dbb3c847d499b16a749c9d5923'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.725320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e626c866-5a29-4987-9e2b-cdf8c997cd9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3639d0dbb3c847d499b16a749c9d5923'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.728092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 956/1903] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:09.728930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.730406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.731918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 948/1904] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:09 2022] DELETE /identity/v3/users/3639d0dbb3c847d499b16a749c9d5923 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:09.736330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.736693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.737035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.748979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aeecb-1e7e-463a-95ef-83ee16f50e2c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.758035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:09.759276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.821661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:09.822549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:09.822829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:09.823106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] PATH_INFO: `/v3/projects/35492461ae054cdf96c98fc4761bd4e6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:09.824519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35492461ae054cdf96c98fc4761bd4e6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:09.826573 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:09.834200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 949/1905] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:09.844892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.846087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:09.876145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:09.882431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:09.896190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35492461ae054cdf96c98fc4761bd4e6', 'request_id': 'req-156a906e-8568-456b-830d-6666f35dcd3d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.905491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35492461ae054cdf96c98fc4761bd4e6', 'request_id': 'req-156a906e-8568-456b-830d-6666f35dcd3d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.916883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35492461ae054cdf96c98fc4761bd4e6', 'request_id': 'req-156a906e-8568-456b-830d-6666f35dcd3d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.934025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee63b5-c13a-4107-9f3e-0abe30051b65 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:09.935668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] The token cache is being invalidate because project 35492461ae054cdf96c98fc4761bd4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:09.936135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.936783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:09.938714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 957/1906] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:09 2022] DELETE /identity/v3/projects/35492461ae054cdf96c98fc4761bd4e6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:09.943778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:09.947383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.004496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:10.005161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.005445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.005757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.009106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.054650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a906e-8568-456b-830d-6666f35dcd3d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:10.061819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:10.062803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.063094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.063379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] PATH_INFO: `/v3/users/e2468532c9004527a0294c4312835381` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.064683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2468532c9004527a0294c4312835381)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:10.067314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:10.092565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:10.094077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:10.104235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 950/1907] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:10.105066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:10.106418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.118666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae184e-8854-4b39-8a45-f3d9e54a364e service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:10.122384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2468532c9004527a0294c4312835381'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.125475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:10.126357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.126641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.126916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] PATH_INFO: `/v3/projects/2450da4e5b334e918d867b4a0e105206` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.128634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2450da4e5b334e918d867b4a0e105206)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:10.130197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:10.136877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2468532c9004527a0294c4312835381'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.137612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2468532c9004527a0294c4312835381'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.145811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2468532c9004527a0294c4312835381'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.157228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2468532c9004527a0294c4312835381'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.165833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 958/1908] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:09 2022] DELETE /identity/v3/users/e2468532c9004527a0294c4312835381 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:10.197708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2450da4e5b334e918d867b4a0e105206', 'request_id': 'req-728c8807-471a-4909-a581-eb0e7a17e6e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.207886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2450da4e5b334e918d867b4a0e105206', 'request_id': 'req-728c8807-471a-4909-a581-eb0e7a17e6e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.217972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2450da4e5b334e918d867b4a0e105206', 'request_id': 'req-728c8807-471a-4909-a581-eb0e7a17e6e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.232989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] The token cache is being invalidate because project 2450da4e5b334e918d867b4a0e105206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:10.233166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.234142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.236334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 951/1909] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:10 2022] DELETE /identity/v3/projects/2450da4e5b334e918d867b4a0e105206 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:10.240112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:10.242561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.338603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:10.366777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21299e8-0f8f-4633-9b9d-22a68bb858ac admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:10.452597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:10.453505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.453789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.454280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] PATH_INFO: `/v3/users/3f1c49bffb744fcca10532c378ec9c97` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.455520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1c49bffb744fcca10532c378ec9c97)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:10.457685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:10.517029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1c49bffb744fcca10532c378ec9c97'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.530739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1c49bffb744fcca10532c378ec9c97'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.531474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1c49bffb744fcca10532c378ec9c97'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.541220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1c49bffb744fcca10532c378ec9c97'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.549542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1c49bffb744fcca10532c378ec9c97'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.557641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 959/1910] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:10 2022] DELETE /identity/v3/users/3f1c49bffb744fcca10532c378ec9c97 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:10.607446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:10.608967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.628029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8807-471a-4909-a581-eb0e7a17e6e6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:10.634559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:10.636731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.656752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:10.750714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6a396-197f-4058-8255-ace2bff1e612 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:10.753004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:10.754032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.754417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.754878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] PATH_INFO: `/v3/projects/8fe184b994f94e8f82ff4ae8888efa1d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.756750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe184b994f94e8f82ff4ae8888efa1d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:10.760513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:10.760784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:10.762653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.763066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.763324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] PATH_INFO: `/v3/projects/5c86241d25ab43b8a0a68fe8d2aad90a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.765658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c86241d25ab43b8a0a68fe8d2aad90a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:10.767997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:10.787745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:10.863849 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe184b994f94e8f82ff4ae8888efa1d', 'request_id': 'req-681a6e9d-99b8-460f-af78-42e54fd6ff26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.875322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c86241d25ab43b8a0a68fe8d2aad90a', 'request_id': 'req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.876791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe184b994f94e8f82ff4ae8888efa1d', 'request_id': 'req-681a6e9d-99b8-460f-af78-42e54fd6ff26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.882792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c86241d25ab43b8a0a68fe8d2aad90a', 'request_id': 'req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.888200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe184b994f94e8f82ff4ae8888efa1d', 'request_id': 'req-681a6e9d-99b8-460f-af78-42e54fd6ff26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.893104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c86241d25ab43b8a0a68fe8d2aad90a', 'request_id': 'req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.907078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] The token cache is being invalidate because project 5c86241d25ab43b8a0a68fe8d2aad90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:10.907403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.908091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9dc88cd9-7ed0-4ae4-bfb5-1c256feba4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.908854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] The token cache is being invalidate because project 8fe184b994f94e8f82ff4ae8888efa1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:10.909367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.913172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 960/1911] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:10 2022] DELETE /identity/v3/projects/5c86241d25ab43b8a0a68fe8d2aad90a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:10.913319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:10.915296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:10.915296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:10.915471 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:10.916750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 952/1912] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:10 2022] DELETE /identity/v3/projects/8fe184b994f94e8f82ff4ae8888efa1d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:10.921885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:10.924135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:10.953482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:10.954910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:11.028304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a6e9d-99b8-460f-af78-42e54fd6ff26 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.075429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 961/1913] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:11.081758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.081758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:11.093843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:11.100977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613ccb-3f2c-4d45-80ac-47a5928008b7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.108305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.109276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.109562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.109841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] PATH_INFO: `/v3/projects/6614ec91f3554ab187469345f2d7dba1` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.111248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6614ec91f3554ab187469345f2d7dba1)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.113667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.119846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.121715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.124996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.125952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] PATH_INFO: `/v3/users/1173e8032bd54ed1a35fd67bfbe46e87` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.128622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1173e8032bd54ed1a35fd67bfbe46e87)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.131723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.185990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6614ec91f3554ab187469345f2d7dba1', 'request_id': 'req-bb02208d-b225-4f18-8016-979657f4d1d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.193595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6614ec91f3554ab187469345f2d7dba1', 'request_id': 'req-bb02208d-b225-4f18-8016-979657f4d1d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.198944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1173e8032bd54ed1a35fd67bfbe46e87'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.201934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6614ec91f3554ab187469345f2d7dba1', 'request_id': 'req-bb02208d-b225-4f18-8016-979657f4d1d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.212917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1173e8032bd54ed1a35fd67bfbe46e87'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.217096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] The token cache is being invalidate because project 6614ec91f3554ab187469345f2d7dba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:11.217390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.218063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bb02208d-b225-4f18-8016-979657f4d1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.220114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 962/1914] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:11 2022] DELETE /identity/v3/projects/6614ec91f3554ab187469345f2d7dba1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:11.220789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1173e8032bd54ed1a35fd67bfbe46e87'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.221920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1173e8032bd54ed1a35fd67bfbe46e87'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.225692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.226027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.226355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.233045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bba80dda-bfc5-4e6b-9be9-f33bac19cea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1173e8032bd54ed1a35fd67bfbe46e87'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:11.240591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 953/1915] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:10 2022] DELETE /identity/v3/users/1173e8032bd54ed1a35fd67bfbe46e87 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:11.241876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7774a-c7f6-4c2c-a6b2-1e3c6a4e72aa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.242170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7774a-c7f6-4c2c-a6b2-1e3c6a4e72aa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.242450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7774a-c7f6-4c2c-a6b2-1e3c6a4e72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.256735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:11.258028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:11.263347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fab7774a-c7f6-4c2c-a6b2-1e3c6a4e72aa None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:11.264999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fab7774a-c7f6-4c2c-a6b2-1e3c6a4e72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:11.280457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:11.343236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 963/1916] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:11.347478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.362479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603266a-175c-4ac6-b7d0-363a669a6480 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.371270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.372375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.372375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.372545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.373329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:11.373647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.375333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 954/1917] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:11.375655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.384232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.385024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.385024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.390698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 964/1918] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:05:11.395227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.406525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaee5-5263-4f37-a1ab-b60471f12365 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.408156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:11.409431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:11.413080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.413794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.414081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.414411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.415289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.417946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.419186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 955/1919] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:11.423793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.435228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc220af4-1a00-43e9-93cb-00259e377795 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.441159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.441963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.442363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.442787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.444007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:11.444813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.447737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.472510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 956/1920] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:11.474055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.487611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72375ed-8bfb-41f8-8380-eac9f1db2e25 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.492106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 965/1921] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:11.494018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.494959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.495419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.495861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.496666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.497637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.499127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.547911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 957/1922] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:11.552585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.580929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7450b-7722-4ee6-9139-782cb4258d9f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.596206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:11.648920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.649713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.649910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.650878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.651609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.653656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.672984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266112a-27a7-4fde-9439-c9e056414bba admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.686976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 966/1923] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:11.689655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.696933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.697639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.697923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.698199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.698900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.701475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.706662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a292de-baf6-4095-8fcb-10cac3983469 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.712369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.713224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.713518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.713918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.714832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.717421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.735798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 958/1924] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:11.740596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.747095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 967/1925] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:11.749256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.763927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df7725-7955-483f-8cbf-9de54de576b2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.768674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c2c97-ef2c-425d-9a86-c59a3b22ffe6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.768809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.769589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.769974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.770909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.782650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.783557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.783636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.783846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.784061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.784876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.786734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.788093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.810975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 959/1926] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:11.811860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 968/1927] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:11.818096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.820202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.830473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:11.834259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1045b-a18f-4ae8-ac43-0390f651f339 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.838808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6e38-c8a2-437c-b28a-50b24fbc4151 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.844771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.845430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.845717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.845992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.847463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.849135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.851621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca5626-3c87-4c4c-b934-f3e5eb1b383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.852589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca5626-3c87-4c4c-b934-f3e5eb1b383c admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.852874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca5626-3c87-4c4c-b934-f3e5eb1b383c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.853152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca5626-3c87-4c4c-b934-f3e5eb1b383c admin admin] PATH_INFO: `/v3/projects/69cda6eff5f04fb385af7a8922aa38fe/users/536362ce3d75424ca3b0d550f58ca296/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.874203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 960/1928] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:11.878153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:11.897196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c269c-1e81-4547-95c6-2aaf7391b3ae admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:11.900817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca5626-3c87-4c4c-b934-f3e5eb1b383c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cda6eff5f04fb385af7a8922aa38fe, user_id=536362ce3d75424ca3b0d550f58ca296, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.916820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7de06-7ad8-413c-8fae-c823f84b33a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:11.917833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7de06-7ad8-413c-8fae-c823f84b33a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.918113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7de06-7ad8-413c-8fae-c823f84b33a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.918392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7de06-7ad8-413c-8fae-c823f84b33a9 admin admin] PATH_INFO: `/v3/projects/c7c5fc6248c34fa4ba15dcca5c373c6e/users/1d70360285e14db4a2f126874f71f103/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.920288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca5626-3c87-4c4c-b934-f3e5eb1b383c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.945382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7de06-7ad8-413c-8fae-c823f84b33a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c5fc6248c34fa4ba15dcca5c373c6e, user_id=1d70360285e14db4a2f126874f71f103, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:11.952335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7de06-7ad8-413c-8fae-c823f84b33a9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:11.958701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 969/1929] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:11 2022] PUT /identity/v3/projects/69cda6eff5f04fb385af7a8922aa38fe/users/536362ce3d75424ca3b0d550f58ca296/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:11.970345 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:11.970773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:11.971154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:11.991937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 961/1930] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:11 2022] PUT /identity/v3/projects/c7c5fc6248c34fa4ba15dcca5c373c6e/users/1d70360285e14db4a2f126874f71f103/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:12.008640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.009069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.009237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.035298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] MFA Rules not processed for user `536362ce3d75424ca3b0d550f58ca296`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:12.036965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:12.069790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] MFA Rules not processed for user `1d70360285e14db4a2f126874f71f103`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:12.071059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:12.137546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 970/1931] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:12.143603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.272625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 962/1932] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:12.277624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.300824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714159-6383-4922-b8f2-46fdfd3ebb3f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.312035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.312745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.313124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.313558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.314454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.317357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcffb5-f659-45c2-94db-f1c6d85005cf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.319429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.332636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.333341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.333690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.333974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.334783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.336816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.440400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 963/1933] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:12.441942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.445122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:12.450554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 971/1934] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/projects => generated 381 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:12.450554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.543029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:12.557555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:12.567713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f58d-c59d-4c5d-9f3e-7f6319dd9254 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.574234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845ed3-0d9f-4901-9374-fa2200650848 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.575497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.576498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.576914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.577373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.578156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.580464 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.602659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.603830 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.604395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.604791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] PATH_INFO: `/v3/projects/98b307ead75548f595eaabfcb4c948f6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.606834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b307ead75548f595eaabfcb4c948f6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.611156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.617491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 972/1935] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:12.620650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.679040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9821ad7-cd6e-470a-9a5c-d62c97007a25 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.711735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.712970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.713484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.714182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.715092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.719322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.741567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b307ead75548f595eaabfcb4c948f6', 'request_id': 'req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:12.750970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b307ead75548f595eaabfcb4c948f6', 'request_id': 'req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:12.760594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b307ead75548f595eaabfcb4c948f6', 'request_id': 'req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:12.771046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 973/1936] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:12.771046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.779677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] The token cache is being invalidate because project 98b307ead75548f595eaabfcb4c948f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:12.780193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:12.781159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:12.781493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd952432-d34e-4d2a-b511-97dc80fbb00c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.783670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 964/1937] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:12 2022] DELETE /identity/v3/projects/98b307ead75548f595eaabfcb4c948f6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:12.784404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.785910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:12.845776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd1938-8bd6-429b-8cb9-723fb3059af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.846609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd1938-8bd6-429b-8cb9-723fb3059af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.846964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd1938-8bd6-429b-8cb9-723fb3059af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.847309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd1938-8bd6-429b-8cb9-723fb3059af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.848157 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd1938-8bd6-429b-8cb9-723fb3059af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.850165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd1938-8bd6-429b-8cb9-723fb3059af0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.857186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b4c71-f8fc-47c1-a5a4-cbbe8bbea32b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.865623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 974/1938] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:12.865623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.865623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.865623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.867512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.868232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.868598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.869252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.870026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.872060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.885563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 965/1939] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:12.886287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.888362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:12.893675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:12.895388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:12.906220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b904d-73c0-4b1c-abae-d54371fde0a1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.906821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 975/1940] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:12.907906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:12.911791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fcc31-0a66-4dcf-9c83-b5f99b8603e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.912585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fcc31-0a66-4dcf-9c83-b5f99b8603e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.912918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fcc31-0a66-4dcf-9c83-b5f99b8603e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.913186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fcc31-0a66-4dcf-9c83-b5f99b8603e7 admin admin] PATH_INFO: `/v3/projects/819c2185f9484d059eb8be148bd18bea/users/3be6fd5eb5354a2696ef9a1a743d1614/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.918804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73a2ba-2ec1-46ff-8c2b-61e386ce5240 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:12.925792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:12.927188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.927314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.927691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] PATH_INFO: `/v3/projects/252dcef9cba443ddac544467c80cc4d3/users/93454176193e45c8b3a1f83585c77c4d/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.934740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fcc31-0a66-4dcf-9c83-b5f99b8603e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819c2185f9484d059eb8be148bd18bea, user_id=3be6fd5eb5354a2696ef9a1a743d1614, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.938259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fcc31-0a66-4dcf-9c83-b5f99b8603e7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.945759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=252dcef9cba443ddac544467c80cc4d3, user_id=93454176193e45c8b3a1f83585c77c4d, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:12.949096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:12.957999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 966/1941] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:12 2022] PUT /identity/v3/projects/819c2185f9484d059eb8be148bd18bea/users/3be6fd5eb5354a2696ef9a1a743d1614/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:12.962597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:12.963042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:12.963334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:12.966082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 976/1942] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:12 2022] PUT /identity/v3/projects/252dcef9cba443ddac544467c80cc4d3/users/93454176193e45c8b3a1f83585c77c4d/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:12.967926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.000216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:13.002494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:13.055389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:13.070717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749ae4-31bb-4a35-a50f-c5ae24b640ae admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.077784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.078857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.079150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.079433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.080773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.082879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.096704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 977/1943] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:13.100777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.110136 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 967/1944] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:13.111160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.126896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2607e-6392-4fbd-a018-bb7974cdd0eb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.129667 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af53007-7916-4d30-a1cd-c83b338a8a23 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.132447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.133241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.133626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.133997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.135137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.137350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.138731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.140917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.141748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.141748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] PATH_INFO: `/v3/projects/819c2185f9484d059eb8be148bd18bea/users/3be6fd5eb5354a2696ef9a1a743d1614/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.145542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819c2185f9484d059eb8be148bd18bea, user_id=3be6fd5eb5354a2696ef9a1a743d1614, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.153043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 978/1945] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:13.154611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.156749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.167805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3cbf4-b898-4652-a88b-b9ec5fa47c25 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.173986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 968/1946] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:13 2022] PUT /identity/v3/projects/819c2185f9484d059eb8be148bd18bea/users/3be6fd5eb5354a2696ef9a1a743d1614/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:13.175520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.193006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:13.256329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.257145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.257501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.257849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.258889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:13.259179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.261051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fa1bd-48a8-4cdc-90a1-0e1abdc25515 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.286291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 979/1947] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:13.286291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996318f-6810-4c10-9fa9-78eb6cba849a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.286970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996318f-6810-4c10-9fa9-78eb6cba849a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.286970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996318f-6810-4c10-9fa9-78eb6cba849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.289596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce199e3-1187-4b38-b997-6684728fd7c8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.297873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.298905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.299262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.299738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] PATH_INFO: `/v3/projects/252dcef9cba443ddac544467c80cc4d3/users/93454176193e45c8b3a1f83585c77c4d/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.302032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252dcef9cba443ddac544467c80cc4d3, user_id=93454176193e45c8b3a1f83585c77c4d, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.307229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.324138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 969/1948] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:13 2022] PUT /identity/v3/projects/252dcef9cba443ddac544467c80cc4d3/users/93454176193e45c8b3a1f83585c77c4d/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:13.325690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.330654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3996318f-6810-4c10-9fa9-78eb6cba849a None None] MFA Rules not processed for user `3be6fd5eb5354a2696ef9a1a743d1614`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:13.331924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3996318f-6810-4c10-9fa9-78eb6cba849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:13.453495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 980/1949] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:13.455132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.455498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.455705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.465972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e371c-ef7a-4f37-a114-356c0ad54a27 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.481105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.481105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.481105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.481105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.481408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.482835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.509415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] MFA Rules not processed for user `93454176193e45c8b3a1f83585c77c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:13.510646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:13.540098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 970/1950] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:13 2022] POST /identity/v3/projects => generated 359 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:13.541316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.546862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:13.637306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:13.650249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6606-1301-4ffc-81ba-952257e7316a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.659120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.661191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.661471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.661950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.668306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 981/1951] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:13.673553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.696719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d699c6-b4e5-4368-a647-596cd42b4492 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.741016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:13.765835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.767620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.780133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 971/1952] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:13.781301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.783792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:13.809741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9744-c578-4921-a19a-74e0aef98e4c service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.818298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.819200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.819625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.820037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.820163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.821062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.821193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.821434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.821566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.824034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.863548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 982/1953] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:13 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:13.866971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.878394 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881dd4-ef79-4034-a0da-cb1f3dfa852e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.884399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.885089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.885423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.885707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.893542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.896236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.912544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 983/1954] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:13.917675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.941513 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34aab-237c-4747-9add-1c435a4be7bc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:13.946923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:13.948411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:13.949678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:13.950377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:13.950562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:13.951441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:13.953481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:13.967147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 972/1955] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:13.969271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:13.999796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f3c9-9c32-49d6-9190-40e97c841cc1 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.010487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.014318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.014688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.015494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.016015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.017875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.031151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 973/1956] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:14.035260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:14.054755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e470c-3244-460e-8f75-5ef1afe80bc3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.065122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.066267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.067001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deada011-822e-4ad8-aacb-299e5eda48ca service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.067422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.067713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.068141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] PATH_INFO: `/v3/projects/3ac8cc4f64ad46cda9f4a56b2f077c2a/users/296cccab1b8c43a5b77f3ab3ba8e0401/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.080681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 984/1957] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:14.087930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac8cc4f64ad46cda9f4a56b2f077c2a, user_id=296cccab1b8c43a5b77f3ab3ba8e0401, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.090838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.115731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 974/1958] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:14 2022] PUT /identity/v3/projects/3ac8cc4f64ad46cda9f4a56b2f077c2a/users/296cccab1b8c43a5b77f3ab3ba8e0401/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:14.127191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30adf56-6841-4a44-8a7f-3ca1aa1450cc None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.127497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30adf56-6841-4a44-8a7f-3ca1aa1450cc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.127805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30adf56-6841-4a44-8a7f-3ca1aa1450cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.143294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:14.145443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.174608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f30adf56-6841-4a44-8a7f-3ca1aa1450cc None None] MFA Rules not processed for user `296cccab1b8c43a5b77f3ab3ba8e0401`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:14.177870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f30adf56-6841-4a44-8a7f-3ca1aa1450cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.249668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:14.265173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02380b3a-0b61-443c-b322-5e82b837f120 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.271198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 985/1959] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:14.276852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.278182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.278182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.281416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] PATH_INFO: `/v3/users/59c576cd1e654efc8685eb4392b7b7c6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.283128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c576cd1e654efc8685eb4392b7b7c6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.285890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.364344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c576cd1e654efc8685eb4392b7b7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:14.388965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c576cd1e654efc8685eb4392b7b7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:14.403815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c576cd1e654efc8685eb4392b7b7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:14.405213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c576cd1e654efc8685eb4392b7b7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:14.417582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c576cd1e654efc8685eb4392b7b7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:14.427811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 975/1960] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:14 2022] DELETE /identity/v3/users/59c576cd1e654efc8685eb4392b7b7c6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:14.433167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.433587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.433995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.474040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:14.476584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.477375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:14.478415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.517549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:14.590196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 986/1961] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:14.600419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:14.602422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.622329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ecbbb-390a-421b-945d-0a6c8a2cd2f9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.627980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.628948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.629294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.629681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.631820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.726902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f73f38-37ad-4a2f-b8e1-56df2adbc498 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.734073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.734984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.735397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.735923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.751907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.754745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.770271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 987/1962] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:14.771184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:14.773305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.779037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.781859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.790243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af7ded-32ac-4af0-b38f-c8233f6a588a service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.797255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.799292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.799675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.800114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.802855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.806982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 976/1963] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:14.881056 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.882917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78408e67-fbd5-461c-9b45-7c33f8a88348 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.894484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 988/1964] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:14.909365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:14.911317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:14.931710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9924e-f0be-46b3-8d32-c6b0f6d7a815 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:14.938764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:14.939483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:14.939930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:14.940039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] PATH_INFO: `/v3/users/296cccab1b8c43a5b77f3ab3ba8e0401` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:14.941567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=296cccab1b8c43a5b77f3ab3ba8e0401)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:14.944660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:14.974068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:15.023438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296cccab1b8c43a5b77f3ab3ba8e0401'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.048340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296cccab1b8c43a5b77f3ab3ba8e0401'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.054040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296cccab1b8c43a5b77f3ab3ba8e0401'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.055801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296cccab1b8c43a5b77f3ab3ba8e0401'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.065605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296cccab1b8c43a5b77f3ab3ba8e0401'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.074077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 977/1965] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:14 2022] DELETE /identity/v3/users/296cccab1b8c43a5b77f3ab3ba8e0401 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:15.078650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:15.079313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:15.079980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:15.102739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:15.104162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:15.183410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 989/1966] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:15.193031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:15.194701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:15.203173 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:15.204813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:15.220797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef928c-592e-4af3-b051-a97fb4f02c93 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:15.226798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:15.227743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:15.228081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:15.228361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] PATH_INFO: `/v3/projects/9192df3abbca43f0a315e92b09282f94` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:15.230064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9192df3abbca43f0a315e92b09282f94)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:15.234013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:15.243245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:15.294015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba5af2-f650-4670-b1f3-fd618439c783 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:15.311156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9192df3abbca43f0a315e92b09282f94', 'request_id': 'req-e38237f9-4625-4ecc-91b0-459e2283143a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.318526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9192df3abbca43f0a315e92b09282f94', 'request_id': 'req-e38237f9-4625-4ecc-91b0-459e2283143a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.328690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9192df3abbca43f0a315e92b09282f94', 'request_id': 'req-e38237f9-4625-4ecc-91b0-459e2283143a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.342084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] The token cache is being invalidate because project 9192df3abbca43f0a315e92b09282f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:15.342368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.343768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.345939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 990/1967] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:15 2022] DELETE /identity/v3/projects/9192df3abbca43f0a315e92b09282f94 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:15.349342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:15.350900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:15.356385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:15.357757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:15.357950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:15.358285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:15.360162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:15.416202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38237f9-4625-4ecc-91b0-459e2283143a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:15.421562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:15.422440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:15.422716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:15.422984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] PATH_INFO: `/v3/users/96f110dd736f44ecbecc2a17028f519c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:15.424316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f110dd736f44ecbecc2a17028f519c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:15.424447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:15.425810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:15.426731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:15.435415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 978/1968] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:15.474998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f110dd736f44ecbecc2a17028f519c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.488232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f110dd736f44ecbecc2a17028f519c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.489077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f110dd736f44ecbecc2a17028f519c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.497271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f110dd736f44ecbecc2a17028f519c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.506136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eef322aa-ceb0-4718-94aa-ced1a93391ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f110dd736f44ecbecc2a17028f519c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:15.513123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 991/1969] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:15 2022] DELETE /identity/v3/users/96f110dd736f44ecbecc2a17028f519c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:15.815194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:15.817444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:15.839793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586239f-15b1-4348-ab29-21ccad7d0600 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:15.845946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:15.921463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411034-e362-43a9-9471-b2aa9bba0a56 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:15.922422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411034-e362-43a9-9471-b2aa9bba0a56 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:15.922907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411034-e362-43a9-9471-b2aa9bba0a56 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:15.925153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 992/1970] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:05:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:05:15.951643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:15.959086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:15.960174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.019313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:16.021868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.053966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:16.104555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:16.105583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:16.109091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:16.109505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] PATH_INFO: `/v3/projects/3ac8cc4f64ad46cda9f4a56b2f077c2a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.111321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac8cc4f64ad46cda9f4a56b2f077c2a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:16.114709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:16.201132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 993/1971] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:05:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:16.213316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:16.217369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.239883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac8cc4f64ad46cda9f4a56b2f077c2a', 'request_id': 'req-df12b330-3ed3-4dcb-9b55-b5c547806d50'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.257345 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec77a2-be7d-40bd-b1e2-0b8eb500bc2d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:16.259841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac8cc4f64ad46cda9f4a56b2f077c2a', 'request_id': 'req-df12b330-3ed3-4dcb-9b55-b5c547806d50'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.275415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac8cc4f64ad46cda9f4a56b2f077c2a', 'request_id': 'req-df12b330-3ed3-4dcb-9b55-b5c547806d50'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.312430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] The token cache is being invalidate because project 3ac8cc4f64ad46cda9f4a56b2f077c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:16.316191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.317696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-df12b330-3ed3-4dcb-9b55-b5c547806d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.324799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 979/1972] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:15 2022] DELETE /identity/v3/projects/3ac8cc4f64ad46cda9f4a56b2f077c2a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:16.326743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:16.327151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:16.327437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.383684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:16.389160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.452170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:16.453252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:16.453695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:16.453975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] PATH_INFO: `/v3/projects/3b51a44c0601477b855f210dea0d0755` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.464109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b51a44c0601477b855f210dea0d0755)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:16.466436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:16.549095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 980/1973] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:16.555187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:16.563223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.615102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b51a44c0601477b855f210dea0d0755', 'request_id': 'req-7c932add-b852-4eda-bcc9-32af31a6e2ca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.624781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b51a44c0601477b855f210dea0d0755', 'request_id': 'req-7c932add-b852-4eda-bcc9-32af31a6e2ca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.657676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b51a44c0601477b855f210dea0d0755', 'request_id': 'req-7c932add-b852-4eda-bcc9-32af31a6e2ca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.692945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:16.715809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] The token cache is being invalidate because project 3b51a44c0601477b855f210dea0d0755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:16.715809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.717708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7c932add-b852-4eda-bcc9-32af31a6e2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:16.725243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 994/1974] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:16 2022] DELETE /identity/v3/projects/3b51a44c0601477b855f210dea0d0755 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:16.727044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:16.737003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:16.737501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.786625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:16.788668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.806067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769cc0e-34ca-4f11-8a6d-11abb3b65037 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:16.837984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:16.917647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 995/1975] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:16.918719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:16.921103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.935583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:16.936372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:16.936668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:16.936901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.939713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:16.942759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45b1a3-147a-48d2-843e-7a9d26375523 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:16.951467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:16.952352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:16.952638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:16.953236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] PATH_INFO: `/v3/users/437364418439431bbbd73639941343c6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:16.955048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437364418439431bbbd73639941343c6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:16.957471 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:16.992032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:16.994275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.036721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 981/1976] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:17.037467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.051990 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102550-f3da-45f0-9bc9-e80a79d94ea3 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.054597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437364418439431bbbd73639941343c6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:17.058922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:17.059604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.059921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.060755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.060964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:17.061281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:17.063164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.082086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 982/1977] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:17.086413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.095528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437364418439431bbbd73639941343c6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:17.097537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437364418439431bbbd73639941343c6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:17.101499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a30-8edc-4d86-8594-8632e35051ba admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.107229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437364418439431bbbd73639941343c6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:17.111434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:17.112215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.112572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.113034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.113701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:17.117591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.130796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437364418439431bbbd73639941343c6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:17.139321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 996/1978] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:16 2022] DELETE /identity/v3/users/437364418439431bbbd73639941343c6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:17.162945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 983/1979] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:17 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:17.166960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.168535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:17.276461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98fb73-c9f1-4915-b789-27ea2af59878 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.385921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:17.402688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:17.403657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.405769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.406206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.409393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:17.413352 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.461126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 997/1980] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:17 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:17.468102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.482500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b170026-0c14-4492-bddd-d4e079d7f4dc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.492125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:17.493039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.493289 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.493636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.494303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:17.496098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.510807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 984/1981] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:17.515090 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.526467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07352a8d-4c16-4fa2-baed-398bbbddf525 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.534791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f040e-ab6c-49e8-9a19-863f36e3c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:17.535671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f040e-ab6c-49e8-9a19-863f36e3c583 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.535957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f040e-ab6c-49e8-9a19-863f36e3c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.536241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f040e-ab6c-49e8-9a19-863f36e3c583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.537074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f040e-ab6c-49e8-9a19-863f36e3c583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:17.539010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f040e-ab6c-49e8-9a19-863f36e3c583 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.554032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 998/1982] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:17.554788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.570175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816a77-23c6-440d-ad7c-8b8a59cc3610 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.578541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:17.580192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.580664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.581036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] PATH_INFO: `/v3/projects/c9bbcf2163404178ade29e4c177d9365/users/e51a43cfa172470ebe806ac6903f6b4b/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.626676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bbcf2163404178ade29e4c177d9365, user_id=e51a43cfa172470ebe806ac6903f6b4b, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:17.632239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:17.663801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 985/1983] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:17 2022] PUT /identity/v3/projects/c9bbcf2163404178ade29e4c177d9365/users/e51a43cfa172470ebe806ac6903f6b4b/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:17.676367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:17.676777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:17.677118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:17.725381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] MFA Rules not processed for user `e51a43cfa172470ebe806ac6903f6b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:17.726762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:17.817233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.821060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:17.910253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 999/1984] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:17.949096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:17.951068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:17.952710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:17.989460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04a77-1388-44d1-95e0-b2d994ece89d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:17.999025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.000010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.000330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.000608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] PATH_INFO: `/v3/projects/1a1b9e952b4e4370a909257690cbdf7a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.002046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1b9e952b4e4370a909257690cbdf7a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.004444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.036875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0577-9081-4d17-8058-016ef55a62ba None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.042117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.042792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.043077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.043463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.055037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.056809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.079427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1000/1985] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:18.089129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1b9e952b4e4370a909257690cbdf7a', 'request_id': 'req-d3ff1a88-d15a-424e-8f8b-97ed24551820'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.098416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1b9e952b4e4370a909257690cbdf7a', 'request_id': 'req-d3ff1a88-d15a-424e-8f8b-97ed24551820'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.107947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.109504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1b9e952b4e4370a909257690cbdf7a', 'request_id': 'req-d3ff1a88-d15a-424e-8f8b-97ed24551820'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.109711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.130463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] The token cache is being invalidate because project 1a1b9e952b4e4370a909257690cbdf7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:18.130860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.131634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d3ff1a88-d15a-424e-8f8b-97ed24551820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.133896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cdc2c-fea2-4f1d-b422-a3bfe24cbff1 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.141808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 986/1986] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:17 2022] DELETE /identity/v3/projects/1a1b9e952b4e4370a909257690cbdf7a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:18.143863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c37a2-3e5f-440b-8895-e5f7a7cbaa6c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.144254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c37a2-3e5f-440b-8895-e5f7a7cbaa6c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.144953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c37a2-3e5f-440b-8895-e5f7a7cbaa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.174824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d98c37a2-3e5f-440b-8895-e5f7a7cbaa6c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:18.177341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d98c37a2-3e5f-440b-8895-e5f7a7cbaa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.242312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.243274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.243567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.243890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] PATH_INFO: `/v3/users/536362ce3d75424ca3b0d550f58ca296` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.245202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536362ce3d75424ca3b0d550f58ca296)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.247444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.255341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:18.286745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 987/1987] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:18.293909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.296011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.296278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.321334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536362ce3d75424ca3b0d550f58ca296'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.321563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:18.322285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.335466 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 988/1988] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:18.339857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.349847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa206578-3685-4526-8348-8185ca1c39e1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.351905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536362ce3d75424ca3b0d550f58ca296'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.352737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536362ce3d75424ca3b0d550f58ca296'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.354882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.355559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.355875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.356148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.356986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:18.357781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.359417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.361999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536362ce3d75424ca3b0d550f58ca296'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.373273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1f851f05-8cb5-40a5-85da-55ed0faeba26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536362ce3d75424ca3b0d550f58ca296'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.376247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 989/1989] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:05:18.381367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.383571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.385260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1001/1990] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:18 2022] DELETE /identity/v3/users/536362ce3d75424ca3b0d550f58ca296 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:18.389442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.389733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.390133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.409068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:18.410039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165944d0-7446-4dba-acc4-fca9981257c3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.410279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.517557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.518381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.518630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.518918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.519960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.521829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1002/1991] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:18.532640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.532762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.534519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.538087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:18.607672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 990/1992] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:18 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:18.612340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.630007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e899d6-f69c-4620-8f50-7825ce8575a6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.684388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:18.699690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.701577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.701827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.702212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.724050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9e90-550e-48e8-b559-29a166251f48 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.729500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.730688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.731179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.731670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.732856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.735357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.771103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 991/1993] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:18 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:18.773274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.785294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4dc4-2bf9-42fe-935e-30229df14c38 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.791827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.792430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.792740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.793546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.794285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.795968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.797636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.799106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.807371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 992/1994] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:18.812329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.828042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1003/1995] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:18.829917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eece17-9afd-4d5e-9cc0-03385b9f4c71 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.836382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.837065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.838000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.838285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.839083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.841035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.860322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 993/1996] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:18.864139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.875935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361de6-ed79-4d98-9d63-ad8d4db953ad service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.882521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:18.884707 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:18.884853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6495-ad2a-4dfd-ba46-fbe75ff7ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.885731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6495-ad2a-4dfd-ba46-fbe75ff7ca45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.886023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6495-ad2a-4dfd-ba46-fbe75ff7ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.886298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6495-ad2a-4dfd-ba46-fbe75ff7ca45 admin admin] PATH_INFO: `/v3/projects/197d038076d84cd6a94e121387381032/users/3909ccceb3ee47589c8e461d0a17cbbe/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.898583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac9e1-98d4-4e31-98c9-e465f6279efa admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:18.903381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:18.904349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.904624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.904896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] PATH_INFO: `/v3/users/1d70360285e14db4a2f126874f71f103` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.906110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d70360285e14db4a2f126874f71f103)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.906566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a6495-ad2a-4dfd-ba46-fbe75ff7ca45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197d038076d84cd6a94e121387381032, user_id=3909ccceb3ee47589c8e461d0a17cbbe, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:18.908120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.909891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a6495-ad2a-4dfd-ba46-fbe75ff7ca45 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:18.931976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1004/1997] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:18 2022] PUT /identity/v3/projects/197d038076d84cd6a94e121387381032/users/3909ccceb3ee47589c8e461d0a17cbbe/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:18.943598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:18.943985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:18.944263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:18.982280 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d70360285e14db4a2f126874f71f103'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:18.985595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] MFA Rules not processed for user `3909ccceb3ee47589c8e461d0a17cbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:18.987356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.008491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d70360285e14db4a2f126874f71f103'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.017285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d70360285e14db4a2f126874f71f103'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.018495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d70360285e14db4a2f126874f71f103'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.028233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-efe715cd-bc10-4911-b966-8efcb80b77b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d70360285e14db4a2f126874f71f103'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.036163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 994/1998] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:18 2022] DELETE /identity/v3/users/1d70360285e14db4a2f126874f71f103 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:19.041257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.041621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.042140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.068803 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:19.070119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.075354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1005/1999] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:19.077204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.078889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.100644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:19.157041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 995/2000] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:19.167401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.168853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.181511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:19.200136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6776-4d2c-4a0f-bbdb-803b448c2780 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.212938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.214089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.214089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.214292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.214846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.217554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.250628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1006/2001] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:19 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:19.254384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.266735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e401c7-4aa9-4812-aafc-4ae961ed11c8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.339564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.340262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.340546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.340821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.366834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d05e68-9c68-4c48-9fce-9f4397b71edc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.377429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.378054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.378430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.378633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.379469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.381700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.412069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1007/2002] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:19 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:19.412069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.415068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.421328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.423102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.427364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bc9e-8910-401d-8c84-7c2951672b72 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.433028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.434349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.434507 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.434801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 996/2003] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:19.435235 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] PATH_INFO: `/v3/projects/69cda6eff5f04fb385af7a8922aa38fe` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.435890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.436741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cda6eff5f04fb385af7a8922aa38fe)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.438775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.448187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682d6a-f724-436a-850a-2bd990f62dba service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.455673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.456413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.456686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.456956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.457991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.461044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.483897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 997/2004] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:19.484828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.496181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34567-ef08-4ea8-84a1-766107e65e10 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.504247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cda6eff5f04fb385af7a8922aa38fe', 'request_id': 'req-9f5fd65d-0410-49c3-924d-f7f9101f9271'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.512190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cda6eff5f04fb385af7a8922aa38fe', 'request_id': 'req-9f5fd65d-0410-49c3-924d-f7f9101f9271'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.523550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cda6eff5f04fb385af7a8922aa38fe', 'request_id': 'req-9f5fd65d-0410-49c3-924d-f7f9101f9271'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.530777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:19.544486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] The token cache is being invalidate because project 69cda6eff5f04fb385af7a8922aa38fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:19.545184 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.546462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.548745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1008/2005] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:19 2022] DELETE /identity/v3/projects/69cda6eff5f04fb385af7a8922aa38fe => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:19.552288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.554217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.610026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.611366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.611714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.612033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] PATH_INFO: `/v3/projects/278402e24c5d48809ea7d5b5780f845e/users/705bc5daee4248408112c6470241dbec/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.632338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] RBAC: Authorizing `identity:create_grant(project_id=278402e24c5d48809ea7d5b5780f845e, user_id=705bc5daee4248408112c6470241dbec, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.635550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.642257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:19.651559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fd65d-0410-49c3-924d-f7f9101f9271 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.669051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 998/2006] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:19 2022] PUT /identity/v3/projects/278402e24c5d48809ea7d5b5780f845e/users/705bc5daee4248408112c6470241dbec/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:19.673686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.682700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.750194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.751467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.751467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.751716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] PATH_INFO: `/v3/users/93454176193e45c8b3a1f83585c77c4d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.754292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=93454176193e45c8b3a1f83585c77c4d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.756680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.839103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93454176193e45c8b3a1f83585c77c4d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.839263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b70b6c-397c-4e09-91f0-b350459f004b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:19.853502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:19.854204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:19.854490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:19.854771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:19.855657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:19.858134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:19.864827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93454176193e45c8b3a1f83585c77c4d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.865984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93454176193e45c8b3a1f83585c77c4d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.881663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93454176193e45c8b3a1f83585c77c4d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.884069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 999/2007] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:19.889006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.891427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.898064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93454176193e45c8b3a1f83585c77c4d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:19.930886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1009/2008] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:19 2022] DELETE /identity/v3/users/93454176193e45c8b3a1f83585c77c4d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:19.936102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:19.939621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:19.940573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2e513-5536-4f8f-8d0d-e7c894dea135 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:20.086222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a101f-2907-4b70-8360-215ae7bf5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:20.087485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a101f-2907-4b70-8360-215ae7bf5eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.088221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a101f-2907-4b70-8360-215ae7bf5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.088919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a101f-2907-4b70-8360-215ae7bf5eb1 admin admin] PATH_INFO: `/v3/projects/278402e24c5d48809ea7d5b5780f845e/users/705bc5daee4248408112c6470241dbec/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.092446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a101f-2907-4b70-8360-215ae7bf5eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278402e24c5d48809ea7d5b5780f845e, user_id=705bc5daee4248408112c6470241dbec, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:20.097198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a101f-2907-4b70-8360-215ae7bf5eb1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:20.108107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13140b7-b80c-41b8-901a-f1f2449312bf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:20.111595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1000/2009] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:19 2022] PUT /identity/v3/projects/278402e24c5d48809ea7d5b5780f845e/users/705bc5daee4248408112c6470241dbec/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:20.125298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.125623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.126057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.170388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:20.173403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] MFA Rules not processed for user `705bc5daee4248408112c6470241dbec`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:20.174678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.207949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:20.254632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:20.255968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.256528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.257031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] PATH_INFO: `/v3/projects/c7c5fc6248c34fa4ba15dcca5c373c6e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.259178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c5fc6248c34fa4ba15dcca5c373c6e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:20.261910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:20.318751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1001/2010] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:20.331629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:20.333294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.343381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c5fc6248c34fa4ba15dcca5c373c6e', 'request_id': 'req-1d5a1ad5-b62b-4505-b516-8163a798ec52'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.356525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c5fc6248c34fa4ba15dcca5c373c6e', 'request_id': 'req-1d5a1ad5-b62b-4505-b516-8163a798ec52'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.370622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c5fc6248c34fa4ba15dcca5c373c6e', 'request_id': 'req-1d5a1ad5-b62b-4505-b516-8163a798ec52'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.391442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] The token cache is being invalidate because project c7c5fc6248c34fa4ba15dcca5c373c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:20.391827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.392407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.395015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1010/2011] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:19 2022] DELETE /identity/v3/projects/c7c5fc6248c34fa4ba15dcca5c373c6e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:20.398891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:20.401598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.425600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807a940-b6db-4de4-b558-c53b04fbc7d2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:20.538846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:20.539832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.540196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.540547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.543746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.563943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1ad5-b62b-4505-b516-8163a798ec52 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:20.580162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:20.581134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.581421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.581698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] PATH_INFO: `/v3/users/3be6fd5eb5354a2696ef9a1a743d1614` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.583630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be6fd5eb5354a2696ef9a1a743d1614)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:20.586104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:20.632295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:20.634034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:20.650935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1002/2012] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:20.652590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:20.654316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.663281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be6fd5eb5354a2696ef9a1a743d1614'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.675589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906edc-41a1-431a-a94e-c8672713f5af service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:20.677444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:20.682993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:20.683963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.684247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.684523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] PATH_INFO: `/v3/projects/252dcef9cba443ddac544467c80cc4d3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.686507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252dcef9cba443ddac544467c80cc4d3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:20.688676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:20.691278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be6fd5eb5354a2696ef9a1a743d1614'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.692683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be6fd5eb5354a2696ef9a1a743d1614'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.703272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be6fd5eb5354a2696ef9a1a743d1614'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.712620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-343a18cb-0e8b-4afc-a7fb-f864962009f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be6fd5eb5354a2696ef9a1a743d1614'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.719682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1011/2013] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:20 2022] DELETE /identity/v3/users/3be6fd5eb5354a2696ef9a1a743d1614 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:20.734515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:20.772332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252dcef9cba443ddac544467c80cc4d3', 'request_id': 'req-8f7ce950-4ba8-49df-bf47-b39738aff076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.784564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252dcef9cba443ddac544467c80cc4d3', 'request_id': 'req-8f7ce950-4ba8-49df-bf47-b39738aff076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.794245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252dcef9cba443ddac544467c80cc4d3', 'request_id': 'req-8f7ce950-4ba8-49df-bf47-b39738aff076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.813515 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] The token cache is being invalidate because project 252dcef9cba443ddac544467c80cc4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:20.813893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.814724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f7ce950-4ba8-49df-bf47-b39738aff076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:20.817525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1003/2014] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:20 2022] DELETE /identity/v3/projects/252dcef9cba443ddac544467c80cc4d3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:20.822981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.823282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.823623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.849089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:20.850343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.944844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1012/2015] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:20.952360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:20.952670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:20.952936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:20.984452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:20.986058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:20.997503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1004/2016] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:21.002224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.015705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870284-7550-45a2-9cb2-897a33b19b59 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.023974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.025132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.025709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.026319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.027576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:21.028385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.031217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.045191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1013/2017] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:05:21.050533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.061792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793b1f0-e202-426a-9db5-6d0fa76ff6b9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.069524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.071091 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.071353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.071634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.072471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.074478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.148710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.149163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.178129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3c07-ab33-4462-a1a4-ae72950122ec admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.184300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1005/2018] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:21.189122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.301410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.302237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.302835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.302835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] PATH_INFO: `/v3/users/e51a43cfa172470ebe806ac6903f6b4b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.304800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51a43cfa172470ebe806ac6903f6b4b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.306754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.336237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f86dc-aa64-4eac-b724-e385350d920b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.348698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.349606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.350024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.350505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.351461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.354045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.387065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51a43cfa172470ebe806ac6903f6b4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.388731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1006/2019] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:21.391485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.393879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.402086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51a43cfa172470ebe806ac6903f6b4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.402983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51a43cfa172470ebe806ac6903f6b4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.405846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:21.407327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf390-7790-4508-9925-67d064c9715e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.414636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51a43cfa172470ebe806ac6903f6b4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.414911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.416251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.416690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.417206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] PATH_INFO: `/v3/projects/819c2185f9484d059eb8be148bd18bea` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.418442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=819c2185f9484d059eb8be148bd18bea)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.421349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.424287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51a43cfa172470ebe806ac6903f6b4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.435484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1014/2020] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:21 2022] DELETE /identity/v3/users/e51a43cfa172470ebe806ac6903f6b4b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:21.436980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.437890 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.473706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819c2185f9484d059eb8be148bd18bea', 'request_id': 'req-74e653c1-8ce2-40a7-b3c1-0308866830bf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.479746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819c2185f9484d059eb8be148bd18bea', 'request_id': 'req-74e653c1-8ce2-40a7-b3c1-0308866830bf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.486532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819c2185f9484d059eb8be148bd18bea', 'request_id': 'req-74e653c1-8ce2-40a7-b3c1-0308866830bf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.496156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=13,keystone:SELECT=81,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:21.501541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] The token cache is being invalidate because project 819c2185f9484d059eb8be148bd18bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:21.502355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.503391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-74e653c1-8ce2-40a7-b3c1-0308866830bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:21.505851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1007/2021] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:21 2022] DELETE /identity/v3/projects/819c2185f9484d059eb8be148bd18bea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:21.508868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1ded-dbe2-4bf3-a8c6-8a073886e184 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.512047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.512047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.512047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.535794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:21.537287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.596696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bc827-869a-4fd3-bc35-19cb4a10bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.597451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc827-869a-4fd3-bc35-19cb4a10bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.597733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc827-869a-4fd3-bc35-19cb4a10bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.598144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc827-869a-4fd3-bc35-19cb4a10bcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.598887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bc827-869a-4fd3-bc35-19cb4a10bcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.601086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bc827-869a-4fd3-bc35-19cb4a10bcf0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.612036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1015/2022] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:21.613609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.613609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.613880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.619484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1008/2023] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:21.620380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.621653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.634175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31f0c9-9af1-49e0-8126-0aacfb51c445 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.639162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:21.640408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.644854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048c89-d2f6-48a8-abd9-8b3323e271b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.645549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048c89-d2f6-48a8-abd9-8b3323e271b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.645835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048c89-d2f6-48a8-abd9-8b3323e271b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.646263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048c89-d2f6-48a8-abd9-8b3323e271b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.647000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048c89-d2f6-48a8-abd9-8b3323e271b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.648799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048c89-d2f6-48a8-abd9-8b3323e271b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.658217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1016/2024] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:21.659218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.663799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1009/2025] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:21.665070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.666793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.667090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.667374 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.687605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:21.689076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.722875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1010/2026] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:21.723977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.742740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7fb3c-3016-4905-90d9-155503bfd582 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.745279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b29e9-1bb9-4415-9a7e-5258a83e14a1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.748420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.749091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.749759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.750131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.760992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80629d2-2f5c-4109-9491-aedde1822b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.762142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80629d2-2f5c-4109-9491-aedde1822b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.762587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80629d2-2f5c-4109-9491-aedde1822b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.763554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80629d2-2f5c-4109-9491-aedde1822b03 admin admin] PATH_INFO: `/v3/projects/c7243fac615a46aabd0bca12c4e0153f/users/c8bf04e4528e4eeabc2aaf615711fc66/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.765037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.766709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.780957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1017/2027] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:21.781960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.797769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80629d2-2f5c-4109-9491-aedde1822b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7243fac615a46aabd0bca12c4e0153f, user_id=c8bf04e4528e4eeabc2aaf615711fc66, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.802985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42284ace-d9fc-48b6-8e05-157de9e2d5cb service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.803178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80629d2-2f5c-4109-9491-aedde1822b03 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.808948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:21.810430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.810733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.811069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.811859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:21.812177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:21.813908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:21.832779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1018/2028] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:21.843654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1011/2029] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:21 2022] PUT /identity/v3/projects/c7243fac615a46aabd0bca12c4e0153f/users/c8bf04e4528e4eeabc2aaf615711fc66/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:21.843903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:21.846408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973490-3871-401b-a023-3e258ae967df None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:21.846823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973490-3871-401b-a023-3e258ae967df None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:21.847144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e973490-3871-401b-a023-3e258ae967df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:21.859614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340a317-734b-4332-879a-c7e819b432ba admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:21.886310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2e973490-3871-401b-a023-3e258ae967df None None] MFA Rules not processed for user `c8bf04e4528e4eeabc2aaf615711fc66`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:21.887717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2e973490-3871-401b-a023-3e258ae967df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:21.895250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:22.001598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1012/2030] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:22.006566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973490-3871-401b-a023-3e258ae967df None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.022280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.023148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.023592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.024241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.025260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.027523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.071219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1019/2031] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:21 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:22.073641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.079652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:22.105456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e973490-3871-401b-a023-3e258ae967df None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.163847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d51e6-d75f-40c0-8c9e-0ccd97fcbff6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.169853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.170619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.171149 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.171552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.172283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.174441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.179384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.180178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.180534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.180825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.181826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.183879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.204088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1020/2032] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:22.208630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.215885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1013/2033] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:22.220963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.223363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:22.225087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24eadb-0d76-4cd9-b021-f24c114543db admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.316385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.317325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.320077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.320077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.320077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.320602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c696d7-5152-462e-8952-906336b17cf6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.320754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.327174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.328405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.328769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.329130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] PATH_INFO: `/v3/projects/c9bbcf2163404178ade29e4c177d9365` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.330482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bbcf2163404178ade29e4c177d9365)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.332550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.343269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1021/2034] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:22.343269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.354835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982549bc-578f-4be3-978d-ac2b2890afcc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.361304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.362117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.362592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.362907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.364129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.366683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.388536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1022/2035] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:22.389433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.396377 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:22.396532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bbcf2163404178ade29e4c177d9365', 'request_id': 'req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:22.400559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27738-ed75-46d9-8070-31845fc0bf9f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.404488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bbcf2163404178ade29e4c177d9365', 'request_id': 'req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:22.412321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bbcf2163404178ade29e4c177d9365', 'request_id': 'req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:22.426764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] The token cache is being invalidate because project c9bbcf2163404178ade29e4c177d9365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:22.427085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:22.427786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:22.429366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1014/2036] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:22 2022] DELETE /identity/v3/projects/c9bbcf2163404178ade29e4c177d9365 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:22.430192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.431508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:22.443314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:22.520629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75efef7-37be-45e9-a82c-f4081d01f28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.521713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efef7-37be-45e9-a82c-f4081d01f28a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.525768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efef7-37be-45e9-a82c-f4081d01f28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.526317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efef7-37be-45e9-a82c-f4081d01f28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.527190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75efef7-37be-45e9-a82c-f4081d01f28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.531185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75efef7-37be-45e9-a82c-f4081d01f28a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.558025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1023/2037] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:22.560679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.562704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.563087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.598915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d99ade-0ec6-45bb-a522-163a4c50e6e8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.610824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:22.615348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:22.617608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e80f5-cc9a-4b77-88f7-406c03e7b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.618468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e80f5-cc9a-4b77-88f7-406c03e7b954 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.618766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e80f5-cc9a-4b77-88f7-406c03e7b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.619686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e80f5-cc9a-4b77-88f7-406c03e7b954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.620648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e80f5-cc9a-4b77-88f7-406c03e7b954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.622272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e80f5-cc9a-4b77-88f7-406c03e7b954 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.643938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1024/2038] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:22.644752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.650290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:22.660402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1015/2039] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:22.663904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.664303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.664525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.673190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323fa1b-01b5-4477-a6be-7ec2be11def4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.680141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.681194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.681543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.681905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] PATH_INFO: `/v3/projects/b5dc4d79e1554f909cf8c4a37ac416e4/users/c171679eed0e401cb22eb11ab80243d2/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.697902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:22.699395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dc4d79e1554f909cf8c4a37ac416e4, user_id=c171679eed0e401cb22eb11ab80243d2, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.699807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:22.703360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.710538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1016/2040] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:22.711736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.724128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6eed0-22a0-446c-8057-a11ab0394c6e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.730822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1025/2041] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:22 2022] PUT /identity/v3/projects/b5dc4d79e1554f909cf8c4a37ac416e4/users/c171679eed0e401cb22eb11ab80243d2/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:22.732604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.822737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ab66c-fd32-4812-b6f7-d02cc197ee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.824651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab66c-fd32-4812-b6f7-d02cc197ee01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.824940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab66c-fd32-4812-b6f7-d02cc197ee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.826452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab66c-fd32-4812-b6f7-d02cc197ee01 admin admin] PATH_INFO: `/v3/projects/47c5db6ea614423292c96eb21d6c995d/users/32742cc285ff4bf8b5a1da13bb634d8a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.853175 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ab66c-fd32-4812-b6f7-d02cc197ee01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c5db6ea614423292c96eb21d6c995d, user_id=32742cc285ff4bf8b5a1da13bb634d8a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.856138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ab66c-fd32-4812-b6f7-d02cc197ee01 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.882925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1017/2042] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:22 2022] PUT /identity/v3/projects/47c5db6ea614423292c96eb21d6c995d/users/32742cc285ff4bf8b5a1da13bb634d8a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:22.883522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd876a6-be81-426e-ad94-036b18a80526 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:22.884720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.885080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.885408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.915122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] MFA Rules not processed for user `c171679eed0e401cb22eb11ab80243d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:22.917686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:22.957632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:22.959209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:22.959498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:22.959799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:22.960545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:22.960854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:22.963525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:22.992852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1026/2043] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:22.992852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:22.998954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1018/2044] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:23.000452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.005132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef0abd-e93f-4596-9a1b-66d2c4ed156b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.010694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.011443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.011808 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.012158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.012485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1fc83-d46b-42e5-a511-da194e2ad9a3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.013551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.015488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.018239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.019112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.019286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.019659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.020722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.021368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:23.022737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.031952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1027/2045] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:23.032767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.034620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:23.044567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7668c-f823-464d-b89b-2512ff9f9be8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.051058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.051736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.052192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.052475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.053154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.055084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.062651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1019/2046] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:22 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:23.063583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.121460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1028/2047] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:23 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:23.121460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.157590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd0d90-9f0a-4a42-a9c6-720dc2400b32 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.232811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141983a-b817-4b1b-b14c-ae8430dd9e16 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.240622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.241988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.242469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.242867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.243562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.246850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.261298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.262320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.262705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.263586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] PATH_INFO: `/v3/projects/47c5db6ea614423292c96eb21d6c995d/users/32742cc285ff4bf8b5a1da13bb634d8a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.265664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c5db6ea614423292c96eb21d6c995d, user_id=32742cc285ff4bf8b5a1da13bb634d8a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.269177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.280262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1029/2048] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:23 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:23.281032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.294688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1020/2049] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:23 2022] PUT /identity/v3/projects/47c5db6ea614423292c96eb21d6c995d/users/32742cc285ff4bf8b5a1da13bb634d8a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:23.294688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.307525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf22d7e-e23b-44f1-91ab-37b03a507463 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.385636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08371963-77a0-4327-84b0-3ba02e051864 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.397737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f31e6-9000-4bf7-b7e6-295268eaef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.399909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f31e6-9000-4bf7-b7e6-295268eaef5b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.400250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f31e6-9000-4bf7-b7e6-295268eaef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.400658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f31e6-9000-4bf7-b7e6-295268eaef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.402321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f31e6-9000-4bf7-b7e6-295268eaef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.405350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f31e6-9000-4bf7-b7e6-295268eaef5b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.412955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.414136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.414579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.415019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.416250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.418525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.420853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1021/2050] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:23.420853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.420853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.420853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.462712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1030/2051] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:23 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:23.463609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.464471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] MFA Rules not processed for user `32742cc285ff4bf8b5a1da13bb634d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:23.466351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:23.479819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab835-bef6-4fd4-a0af-93a0560a5130 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.485695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:23.486219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801536-96b9-4367-8456-702136550870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.487133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801536-96b9-4367-8456-702136550870 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.487494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801536-96b9-4367-8456-702136550870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.487899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801536-96b9-4367-8456-702136550870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.488972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801536-96b9-4367-8456-702136550870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.490918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801536-96b9-4367-8456-702136550870 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.503739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1031/2052] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:23.504835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801536-96b9-4367-8456-702136550870 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.517839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801536-96b9-4367-8456-702136550870 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.524259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.525161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.525443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.525715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.526445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.528066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.539671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1032/2053] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:23.540593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.550863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acbaf0-8360-41b4-9a9f-d541f6af8dbb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.555472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.556387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.556721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.556966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] PATH_INFO: `/v3/projects/e1843cdd14b54fd18d9c4623343ed5f7/users/f3a1e4c97d634eb88e454f9e36424d45/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.574730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1843cdd14b54fd18d9c4623343ed5f7, user_id=f3a1e4c97d634eb88e454f9e36424d45, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.577060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1022/2054] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:23.578281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.578388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.593381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a912d-f28c-4f21-bf05-64ee497e6058 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.593848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1033/2055] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:23 2022] PUT /identity/v3/projects/e1843cdd14b54fd18d9c4623343ed5f7/users/f3a1e4c97d634eb88e454f9e36424d45/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:23.594733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.596865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:23.611357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:23.662733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a255d9-bf84-468d-ab3f-c35e6e9ac6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.663330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a255d9-bf84-468d-ab3f-c35e6e9ac6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.663673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a255d9-bf84-468d-ab3f-c35e6e9ac6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.663981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a255d9-bf84-468d-ab3f-c35e6e9ac6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.664708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a255d9-bf84-468d-ab3f-c35e6e9ac6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.664814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab22ebf-a5e4-4799-9a09-c5d8d218062a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.666619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a255d9-bf84-468d-ab3f-c35e6e9ac6ff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.671204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.672211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.672551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.672990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.688866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1023/2056] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:23.689041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.689645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.689933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.727230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] MFA Rules not processed for user `f3a1e4c97d634eb88e454f9e36424d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:23.728688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:23.752776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.754476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.771628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1034/2057] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:23.772502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.806502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191837db-cba7-4175-a3be-38f7c45f570a service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.818336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff73ae0-4247-4e40-b35e-90a615e0000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.819526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff73ae0-4247-4e40-b35e-90a615e0000f admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.819924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff73ae0-4247-4e40-b35e-90a615e0000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.820434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff73ae0-4247-4e40-b35e-90a615e0000f admin admin] PATH_INFO: `/v3/projects/36836625a6dc41768ef872810e6892de/users/05e8fb4663304d429f7a78070edbb66c/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.826259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1024/2058] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:23.869748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:23.871719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:23.877049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff73ae0-4247-4e40-b35e-90a615e0000f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36836625a6dc41768ef872810e6892de, user_id=05e8fb4663304d429f7a78070edbb66c, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.887478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff73ae0-4247-4e40-b35e-90a615e0000f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.898956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1f93b-f6e6-4d9a-b8cf-f4946cade242 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:23.908590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:23.910048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.911568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.913062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.942263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:23.944755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:23.951320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1035/2059] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:23 2022] PUT /identity/v3/projects/36836625a6dc41768ef872810e6892de/users/05e8fb4663304d429f7a78070edbb66c/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:23.966519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:23.966519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:23.966519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:23.975387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1025/2060] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:24.002952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] MFA Rules not processed for user `05e8fb4663304d429f7a78070edbb66c`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:24.016826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:24.074779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.087706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000ba86-71fd-484f-b4e0-a82ffc3f9c53 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.119923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:24.127845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1036/2061] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:24.130282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.172645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.173225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.173504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.173776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.177667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:24.178022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:24.228346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcc84c-38b0-4edf-8d09-d07a821a571b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.234804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.236385 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.236894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.237366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.238255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.240506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.283100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1037/2062] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:24 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:24.289861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.300176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.301135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.320982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1026/2063] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:24.409933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968d15-053e-431a-b8f2-2308b822808c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.415571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.416760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.417276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.417696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.418582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.421496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.447452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1038/2064] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:24 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:24.452847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.481617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff537f84-5aaf-485f-a472-b7fe54222f4b service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.495813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.497544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.497837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.498119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.503608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.507636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.538978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.546501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1027/2065] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:24.552998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591a723-ab13-44a8-b1ab-85dfcd76bf70 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.568198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.569152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.569461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.569786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] PATH_INFO: `/v3/projects/845bd45b6ad544a9a59f59019bf2fe58/users/1b3d1cb3248f483d8c839f69d556079f/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.590868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845bd45b6ad544a9a59f59019bf2fe58, user_id=1b3d1cb3248f483d8c839f69d556079f, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.596609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.616273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1039/2066] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:24 2022] PUT /identity/v3/projects/845bd45b6ad544a9a59f59019bf2fe58/users/1b3d1cb3248f483d8c839f69d556079f/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:24.620679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.633884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241e9f-197b-407b-be6e-341e28f11b4b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.779721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246638ba-f868-4374-a117-97dc71dbadde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.780449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246638ba-f868-4374-a117-97dc71dbadde admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.780740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246638ba-f868-4374-a117-97dc71dbadde admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.781016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246638ba-f868-4374-a117-97dc71dbadde admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.781766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246638ba-f868-4374-a117-97dc71dbadde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.783947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246638ba-f868-4374-a117-97dc71dbadde admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.802570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1028/2067] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:24.806441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:24.847465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e1fbb-94e5-4ef4-9ed3-2bcffa4ad926 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:24.863450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:24.865085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.865516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.865802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] PATH_INFO: `/v3/projects/845bd45b6ad544a9a59f59019bf2fe58/users/1b3d1cb3248f483d8c839f69d556079f/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.870353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845bd45b6ad544a9a59f59019bf2fe58, user_id=1b3d1cb3248f483d8c839f69d556079f, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:24.883731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:24.923428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1040/2068] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:24 2022] PUT /identity/v3/projects/845bd45b6ad544a9a59f59019bf2fe58/users/1b3d1cb3248f483d8c839f69d556079f/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:24.933348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:24.933573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:24.933850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:24.976910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] MFA Rules not processed for user `1b3d1cb3248f483d8c839f69d556079f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:24.979169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:25.054184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:25.099530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1029/2069] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:25.113935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:25.177617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa62e17-a253-4b3f-a9a3-533bb7220ef4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:25.181439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4166093-e49a-4f57-a011-ece4488b862b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:25.182168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4166093-e49a-4f57-a011-ece4488b862b service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:25.182521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4166093-e49a-4f57-a011-ece4488b862b service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:25.182877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4166093-e49a-4f57-a011-ece4488b862b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:25.194179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4166093-e49a-4f57-a011-ece4488b862b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:25.195557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4166093-e49a-4f57-a011-ece4488b862b service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:25.205937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1041/2070] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:25.840498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:25.853806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b048f7-be87-4afc-827a-4bb66263328b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:25.858223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:25.858883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:25.859163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:25.859433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:25.923630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:25.925220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:25.940700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1030/2071] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:26.356113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72f1f-cb89-4e61-a845-51a148f8f009 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:26.356635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72f1f-cb89-4e61-a845-51a148f8f009 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:26.356719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72f1f-cb89-4e61-a845-51a148f8f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:26.380624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:26.387597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4db72f1f-cb89-4e61-a845-51a148f8f009 None None] MFA Rules not processed for user `f3a1e4c97d634eb88e454f9e36424d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:26.396891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4db72f1f-cb89-4e61-a845-51a148f8f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:26.526270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1042/2072] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:26.924274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:26.939577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8006-8d18-4da6-8422-0749a4653662 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:26.951389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:26.953127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:26.953838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:26.954313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:26.959209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:27.137611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:27.137611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45d0bc-cd55-4f9a-80f9-9b0b5fee859e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:27.151945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1031/2073] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:28.842879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809479f5-10b8-439e-81f4-1695904a35b4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:28.843391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809479f5-10b8-439e-81f4-1695904a35b4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:28.843694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809479f5-10b8-439e-81f4-1695904a35b4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:28.845218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1043/2074] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:05:28.850030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f399406-69b8-431f-8275-f1738202f38e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:28.850456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f399406-69b8-431f-8275-f1738202f38e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:28.850591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f399406-69b8-431f-8275-f1738202f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:28.869908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0f399406-69b8-431f-8275-f1738202f38e None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:28.871233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0f399406-69b8-431f-8275-f1738202f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:28.950813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1032/2075] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:05:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:28.962389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809479f5-10b8-439e-81f4-1695904a35b4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:28.964564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-809479f5-10b8-439e-81f4-1695904a35b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:28.982519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809479f5-10b8-439e-81f4-1695904a35b4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:28.994279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc982-f92f-4be0-a8f6-34b07f45b61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:28.994964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc982-f92f-4be0-a8f6-34b07f45b61c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:28.995228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc982-f92f-4be0-a8f6-34b07f45b61c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:28.995496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc982-f92f-4be0-a8f6-34b07f45b61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:29.005707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fc982-f92f-4be0-a8f6-34b07f45b61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:29.007318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fc982-f92f-4be0-a8f6-34b07f45b61c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:29.018362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1044/2076] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:38.437494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f399406-69b8-431f-8275-f1738202f38e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:38.462746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:38.662829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f399406-69b8-431f-8275-f1738202f38e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:38.673212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:38.674412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:38.675208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:38.675519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] PATH_INFO: `/v3/users/c8bf04e4528e4eeabc2aaf615711fc66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:38.683517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bf04e4528e4eeabc2aaf615711fc66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:38.689736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:38.800897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bf04e4528e4eeabc2aaf615711fc66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:38.830936 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bf04e4528e4eeabc2aaf615711fc66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:38.851403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bf04e4528e4eeabc2aaf615711fc66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:38.852491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bf04e4528e4eeabc2aaf615711fc66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:38.869290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bf04e4528e4eeabc2aaf615711fc66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:38.879800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1033/2077] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:38 2022] DELETE /identity/v3/users/c8bf04e4528e4eeabc2aaf615711fc66 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:38.882996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074021-2967-4c2c-8978-3f239517d456 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:38.883563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074021-2967-4c2c-8978-3f239517d456 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:38.883894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074021-2967-4c2c-8978-3f239517d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:38.923190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-21074021-2967-4c2c-8978-3f239517d456 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:38.926061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-21074021-2967-4c2c-8978-3f239517d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:39.057654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1045/2078] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:39.084211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:39.095461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:39.216032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ceb67-5b4c-47eb-b305-6d92b8d276d8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:39.220223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:39.220898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:39.221182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:39.221458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:39.233034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:39.234531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:39.246314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1034/2079] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:39.757351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074021-2967-4c2c-8978-3f239517d456 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:39.759547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-21074021-2967-4c2c-8978-3f239517d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:39.772732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074021-2967-4c2c-8978-3f239517d456 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:39.778854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:39.780159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:39.780441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:39.780715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] PATH_INFO: `/v3/projects/c7243fac615a46aabd0bca12c4e0153f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:39.782121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7243fac615a46aabd0bca12c4e0153f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:39.784286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:39.846444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7243fac615a46aabd0bca12c4e0153f', 'request_id': 'req-f559a3bf-914a-45fe-b28d-c97ce65956a2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:39.853893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7243fac615a46aabd0bca12c4e0153f', 'request_id': 'req-f559a3bf-914a-45fe-b28d-c97ce65956a2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:39.866273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7243fac615a46aabd0bca12c4e0153f', 'request_id': 'req-f559a3bf-914a-45fe-b28d-c97ce65956a2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:39.885968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] The token cache is being invalidate because project c7243fac615a46aabd0bca12c4e0153f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:39.885968 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:39.886753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:39.887683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1046/2080] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:39 2022] DELETE /identity/v3/projects/c7243fac615a46aabd0bca12c4e0153f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:39.891940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:39.904142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6bdfd-ae67-4989-9197-69c2e0f7bd7c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:39.953482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:39.986427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:39.987335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:39.987635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:39.987940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] PATH_INFO: `/v3/users/32742cc285ff4bf8b5a1da13bb634d8a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:39.989213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32742cc285ff4bf8b5a1da13bb634d8a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:39.991200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:40.046385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32742cc285ff4bf8b5a1da13bb634d8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.059815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32742cc285ff4bf8b5a1da13bb634d8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.067420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32742cc285ff4bf8b5a1da13bb634d8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.068140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32742cc285ff4bf8b5a1da13bb634d8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.076868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32742cc285ff4bf8b5a1da13bb634d8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.083775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1035/2081] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:39 2022] DELETE /identity/v3/users/32742cc285ff4bf8b5a1da13bb634d8a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:40.618515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:40.624204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:40.693762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:40.730571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:40.732554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:40.763177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559a3bf-914a-45fe-b28d-c97ce65956a2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:40.844084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3b1f-f1f9-48b3-89c6-2bce6ae237d2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:40.850708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:40.854400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:40.855362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:40.855824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] PATH_INFO: `/v3/projects/47c5db6ea614423292c96eb21d6c995d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:40.858182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c5db6ea614423292c96eb21d6c995d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:40.860932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:40.873116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:40.876474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:40.877400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:40.877601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:40.889932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:40.941606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c5db6ea614423292c96eb21d6c995d', 'request_id': 'req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.952488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:40.954276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c5db6ea614423292c96eb21d6c995d', 'request_id': 'req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:40.962730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c5db6ea614423292c96eb21d6c995d', 'request_id': 'req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.001422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] The token cache is being invalidate because project 47c5db6ea614423292c96eb21d6c995d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:41.002380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.003512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-433ae5d6-ce69-4f00-86ca-7b27b98c83eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.006065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1036/2082] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:40 2022] DELETE /identity/v3/projects/47c5db6ea614423292c96eb21d6c995d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:41.013157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce1a3-164d-4352-91cb-5667a64c356a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.016725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce1a3-164d-4352-91cb-5667a64c356a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.018028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce1a3-164d-4352-91cb-5667a64c356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.037135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.040465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.051353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d7bce1a3-164d-4352-91cb-5667a64c356a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:41.052953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d7bce1a3-164d-4352-91cb-5667a64c356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:41.066283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1047/2083] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:41.067605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.072055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:41.108239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f86ad-71ab-4904-9725-d2c77456b365 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:41.224109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1037/2084] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:41.227663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.228307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.228836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.268839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:41.270963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:41.300476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1038/2085] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:41.308463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.320810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb358-be32-4ce7-a302-060e9bd73114 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:41.331689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:41.332732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.333173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.333627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.334697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:41.335506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.337677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.355674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1039/2086] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:41.361286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.362676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:41.364208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.364764 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.365363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] PATH_INFO: `/v3/users/3909ccceb3ee47589c8e461d0a17cbbe` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.366999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3909ccceb3ee47589c8e461d0a17cbbe)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.370194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.376920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23cdc8-41eb-4c43-ae81-e00d536b6acc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:41.385283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:41.386331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.386929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.387241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.388022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.391060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.436113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:41.448063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1040/2087] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:41 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:41.462202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.464816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3909ccceb3ee47589c8e461d0a17cbbe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.515624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3909ccceb3ee47589c8e461d0a17cbbe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.516718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3909ccceb3ee47589c8e461d0a17cbbe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.530956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3909ccceb3ee47589c8e461d0a17cbbe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.550300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-031297c2-31f4-4cc4-a663-99c311173470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3909ccceb3ee47589c8e461d0a17cbbe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:41.566292 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1048/2088] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:41 2022] DELETE /identity/v3/users/3909ccceb3ee47589c8e461d0a17cbbe => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:41.575382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.575963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.577131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.620347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:41.622660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:41.650937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54547-5eb4-4de7-a285-2f4ff9eaaf61 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:41.744666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1049/2089] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:41.764688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.766549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:41.783374 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:41.811679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:41.812327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.812610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.817624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.818500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.820543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.868273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1041/2090] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:41 2022] POST /identity/v3/users => generated 287 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:41.873051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.877391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:41.914878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee285-6050-4be4-801c-53dbae842446 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:41.918312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7e389-ebcd-472c-b40e-c38d7b6a5f87 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:41.927731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:41.929534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.930088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.930512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.933475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:41.934163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:41.934499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:41.934766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:41.935514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.937202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.945632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:41.947470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:41.973085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1042/2091] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:41.976848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:41.986005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1050/2092] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:41.995596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99732a9-1a0c-406e-ad7d-22e23197babf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:42.013829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0f4b2-210e-4f02-826d-5b73fc26cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:42.014793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0f4b2-210e-4f02-826d-5b73fc26cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.015237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0f4b2-210e-4f02-826d-5b73fc26cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.016390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0f4b2-210e-4f02-826d-5b73fc26cc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.017291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0f4b2-210e-4f02-826d-5b73fc26cc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:42.020100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0f4b2-210e-4f02-826d-5b73fc26cc5a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:42.035599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1043/2093] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:42.039840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:42.067113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857359b-6301-4d4a-ac88-8d6d3ea97ea7 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:42.073131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:42.074417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.074778 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.075790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] PATH_INFO: `/v3/projects/1c7e7044c1d24b3caca48304b6fd554f/users/59a4477a7b3e415bab2ac673d605dd9f/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.097080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7e7044c1d24b3caca48304b6fd554f, user_id=59a4477a7b3e415bab2ac673d605dd9f, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:42.101084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:42.120198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1051/2094] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:42 2022] PUT /identity/v3/projects/1c7e7044c1d24b3caca48304b6fd554f/users/59a4477a7b3e415bab2ac673d605dd9f/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:42.131704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.132210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.132816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.169166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] MFA Rules not processed for user `59a4477a7b3e415bab2ac673d605dd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:42.170538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:42.279841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1044/2095] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:42.296162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:42.299960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:42.355620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:42.412790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a908-391c-48e7-849a-04e822636e42 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:42.422635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:42.423320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.423715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.424058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.436511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:42.437511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:42.449070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1052/2096] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:42.483730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:42.591789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8999-9922-4b86-a10e-03155d741e8c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:42.600243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:42.604267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.607324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.607769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] PATH_INFO: `/v3/users/59a4477a7b3e415bab2ac673d605dd9f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.611480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a4477a7b3e415bab2ac673d605dd9f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:42.611664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:42.611917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:42.612810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:42.663369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d4253-5da9-495d-a711-441db23633ec service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:42.678455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:42.679953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.680527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.681010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] PATH_INFO: `/v3/projects/197d038076d84cd6a94e121387381032` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.683678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197d038076d84cd6a94e121387381032)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:42.688483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:42.711815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a4477a7b3e415bab2ac673d605dd9f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.715120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:42.730021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a4477a7b3e415bab2ac673d605dd9f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.743842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a4477a7b3e415bab2ac673d605dd9f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.744603 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a4477a7b3e415bab2ac673d605dd9f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.755317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-28fa22ea-a855-4564-9738-c48645fd6162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a4477a7b3e415bab2ac673d605dd9f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.776310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1045/2097] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:42 2022] DELETE /identity/v3/users/59a4477a7b3e415bab2ac673d605dd9f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:42.777004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197d038076d84cd6a94e121387381032', 'request_id': 'req-65c0931f-32d3-4a75-b642-c98239b910b9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.783463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.783963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.784467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.793382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197d038076d84cd6a94e121387381032', 'request_id': 'req-65c0931f-32d3-4a75-b642-c98239b910b9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.807780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197d038076d84cd6a94e121387381032', 'request_id': 'req-65c0931f-32d3-4a75-b642-c98239b910b9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.828587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:42.828886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] The token cache is being invalidate because project 197d038076d84cd6a94e121387381032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:42.829047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.829976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:42.830117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:42.832190 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1053/2098] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:42 2022] DELETE /identity/v3/projects/197d038076d84cd6a94e121387381032 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:42.836217 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:42.837752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:42.925680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0931f-32d3-4a75-b642-c98239b910b9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:42.930440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:42.930887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1046/2099] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:42.931528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:42.931982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:42.932240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] PATH_INFO: `/v3/users/705bc5daee4248408112c6470241dbec` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:42.933501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705bc5daee4248408112c6470241dbec)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:42.935614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:42.940573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:42.941974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:42.992156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705bc5daee4248408112c6470241dbec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:43.004492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:43.011561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705bc5daee4248408112c6470241dbec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:43.013138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705bc5daee4248408112c6470241dbec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:43.023629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89512ef6-306f-4a7c-8567-3d25aa182436 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:43.027708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705bc5daee4248408112c6470241dbec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:43.031853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:43.031853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:43.031853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:43.032393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:43.035220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:43.039614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705bc5daee4248408112c6470241dbec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:43.049518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1054/2100] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:42 2022] DELETE /identity/v3/users/705bc5daee4248408112c6470241dbec => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:43.061512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:43.064509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:43.084926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1047/2101] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:43.834005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:43.835524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:43.850225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:43.851961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:43.867158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7e86c-31c1-4b8d-88a3-e27f53c918c7 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:43.953634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:43.954670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:43.955053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:43.955393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] PATH_INFO: `/v3/projects/1c7e7044c1d24b3caca48304b6fd554f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:43.956925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7e7044c1d24b3caca48304b6fd554f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:43.958960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:43.969281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f1fd-b27d-4e78-9c53-fa173edd9da7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:43.974390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:43.977354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:43.978495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:43.978781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:43.979048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] PATH_INFO: `/v3/projects/278402e24c5d48809ea7d5b5780f845e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:43.980317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=278402e24c5d48809ea7d5b5780f845e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:43.982874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.032126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7e7044c1d24b3caca48304b6fd554f', 'request_id': 'req-aef77379-349b-4b22-801b-33a22f272412'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.038036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7e7044c1d24b3caca48304b6fd554f', 'request_id': 'req-aef77379-349b-4b22-801b-33a22f272412'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.045483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7e7044c1d24b3caca48304b6fd554f', 'request_id': 'req-aef77379-349b-4b22-801b-33a22f272412'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.046657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278402e24c5d48809ea7d5b5780f845e', 'request_id': 'req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.055540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278402e24c5d48809ea7d5b5780f845e', 'request_id': 'req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.060587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] The token cache is being invalidate because project 1c7e7044c1d24b3caca48304b6fd554f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:44.060980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.061765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.063717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1048/2102] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:43 2022] DELETE /identity/v3/projects/1c7e7044c1d24b3caca48304b6fd554f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:44.064400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.065924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.069868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278402e24c5d48809ea7d5b5780f845e', 'request_id': 'req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.089443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] The token cache is being invalidate because project 278402e24c5d48809ea7d5b5780f845e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:44.090066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.090913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0057a8fa-58be-41f0-8d3b-90c7ad4c8acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.093206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1055/2103] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:43 2022] DELETE /identity/v3/projects/278402e24c5d48809ea7d5b5780f845e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:44.099222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05342cb-b782-46ae-b0c4-6e0bf9689c0b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.100055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05342cb-b782-46ae-b0c4-6e0bf9689c0b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.100682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05342cb-b782-46ae-b0c4-6e0bf9689c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.126189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c05342cb-b782-46ae-b0c4-6e0bf9689c0b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:44.138843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c05342cb-b782-46ae-b0c4-6e0bf9689c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.174268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef77379-349b-4b22-801b-33a22f272412 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.272981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1056/2104] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:44.285550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.286049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.286428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.287447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.288892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.289701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.290179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] PATH_INFO: `/v3/users/c171679eed0e401cb22eb11ab80243d2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.298566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c171679eed0e401cb22eb11ab80243d2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.301323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.313051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:44.317748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:44.321883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.334543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1057/2105] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:44.338948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.350579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e16b-d0a1-4927-9422-4cad706e8e91 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.354771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.355447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.355732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.356044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.357327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:44.357636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.359545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.368731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c171679eed0e401cb22eb11ab80243d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.371237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:44.377176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1058/2106] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:44.378391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.384608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c171679eed0e401cb22eb11ab80243d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.391293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7aec-efe5-41ed-ac17-f2552a84eb09 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.393004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c171679eed0e401cb22eb11ab80243d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.393692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c171679eed0e401cb22eb11ab80243d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.397237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.398285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.398661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.399110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.400108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.402149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff9d5b75-5e04-4f7c-b414-195d1604101f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c171679eed0e401cb22eb11ab80243d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:44.402822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.415118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1049/2107] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:44 2022] DELETE /identity/v3/users/c171679eed0e401cb22eb11ab80243d2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:44.415118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.415118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.415118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.433266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:44.434514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.436032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1059/2108] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:44 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:44.440726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.442781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.500073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1050/2109] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:44.509873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.511311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.514852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5b0a-1977-439f-81eb-edb66680b11c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.519569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.520270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.520553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.520989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.521825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.523860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.547409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1060/2110] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:44 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:44.551251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.561097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23e15-b174-4798-a7ad-f45e74674a62 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.566506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.567269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.567578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.567881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.568645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.570272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.577728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6ece-7086-4858-835f-42d8edc8419d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.584110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1061/2111] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:44.584266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.584266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.584266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.584266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.585150 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.593336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.595134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.596744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39666b77-77ce-423a-9392-e4dc6c28cbb3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.601626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4bdb8-b5b3-46ed-ae12-9d8985acfbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.602303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4bdb8-b5b3-46ed-ae12-9d8985acfbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.602590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4bdb8-b5b3-46ed-ae12-9d8985acfbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.602870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4bdb8-b5b3-46ed-ae12-9d8985acfbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.603594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4bdb8-b5b3-46ed-ae12-9d8985acfbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.605240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4bdb8-b5b3-46ed-ae12-9d8985acfbf5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.605812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1051/2112] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:44.619794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1062/2113] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:44.620996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.630771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faf9f1-35fc-4ba9-be01-fdc4f59713c5 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.636143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.637046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.637329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.637606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] PATH_INFO: `/v3/projects/3b21e0a723f74496a1d6a5c7362e75da/users/f88fe209eeec47bd991f7dfb678dd7d8/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.654040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b21e0a723f74496a1d6a5c7362e75da, user_id=f88fe209eeec47bd991f7dfb678dd7d8, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.656992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.672103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1052/2114] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:44 2022] PUT /identity/v3/projects/3b21e0a723f74496a1d6a5c7362e75da/users/f88fe209eeec47bd991f7dfb678dd7d8/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:44.683493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.683820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.684097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.716233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] MFA Rules not processed for user `f88fe209eeec47bd991f7dfb678dd7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:44.717785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.817263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1063/2115] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:44.829817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:44.831604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:44.890943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:44.899873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30962-d760-4dcd-b46d-fae321d5f242 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:44.907698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:44.908434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:44.909317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:44.909317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:44.919828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:44.922860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:44.937681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1053/2116] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:44.969692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:45.009502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:45.062704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee251bee-ac34-4b41-afc8-7fa7e8b8a2fe None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:45.067299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:45.068236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:45.068515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:45.068788 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] PATH_INFO: `/v3/users/f88fe209eeec47bd991f7dfb678dd7d8` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:45.070315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88fe209eeec47bd991f7dfb678dd7d8)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:45.073151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:45.109422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:45.111191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:45.139524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac4608-f7ee-488a-8ba5-0e7ebc747ece service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:45.148979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88fe209eeec47bd991f7dfb678dd7d8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.159081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:45.160665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:45.160947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:45.161337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] PATH_INFO: `/v3/projects/b5dc4d79e1554f909cf8c4a37ac416e4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:45.162519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dc4d79e1554f909cf8c4a37ac416e4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:45.164560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:45.172209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88fe209eeec47bd991f7dfb678dd7d8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.173554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88fe209eeec47bd991f7dfb678dd7d8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.183290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88fe209eeec47bd991f7dfb678dd7d8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.193605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-83a724ce-d2b8-4cb6-b43e-d2ff6bb6cca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88fe209eeec47bd991f7dfb678dd7d8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.200872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1064/2117] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:44 2022] DELETE /identity/v3/users/f88fe209eeec47bd991f7dfb678dd7d8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:45.205786 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:45.206077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:45.206360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:45.224795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dc4d79e1554f909cf8c4a37ac416e4', 'request_id': 'req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.226420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:45.227645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:45.232741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dc4d79e1554f909cf8c4a37ac416e4', 'request_id': 'req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.245600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dc4d79e1554f909cf8c4a37ac416e4', 'request_id': 'req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.267529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] The token cache is being invalidate because project b5dc4d79e1554f909cf8c4a37ac416e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:45.268012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.269107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.271945 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1054/2118] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:45 2022] DELETE /identity/v3/projects/b5dc4d79e1554f909cf8c4a37ac416e4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:45.277669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:45.279678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:45.304222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1065/2119] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:45.317391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:45.319663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:45.386767 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:45.401789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07c5be-603c-4b1f-903d-956959f7c70a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:45.408140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f8038-e27f-4fb8-8e6e-0349268b5b0d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:45.409099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:45.410364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:45.410987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:45.411586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:45.417363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:45.419480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:45.420018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:45.420506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] PATH_INFO: `/v3/users/05e8fb4663304d429f7a78070edbb66c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:45.422772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e8fb4663304d429f7a78070edbb66c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:45.427557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:45.429065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:45.430558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:45.444262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1066/2120] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:45.486144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e8fb4663304d429f7a78070edbb66c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.501768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e8fb4663304d429f7a78070edbb66c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.510706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e8fb4663304d429f7a78070edbb66c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.512551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e8fb4663304d429f7a78070edbb66c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.514866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:45.522396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e8fb4663304d429f7a78070edbb66c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:45.541023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1055/2121] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:45 2022] DELETE /identity/v3/users/05e8fb4663304d429f7a78070edbb66c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:45.819638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:45.821074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:45.834230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d035d4-f745-481c-bb98-3d37f6a53683 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:45.888657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:45.890503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:45.923987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:45.924978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:45.925258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:45.925530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] PATH_INFO: `/v3/projects/3b21e0a723f74496a1d6a5c7362e75da` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:45.926831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b21e0a723f74496a1d6a5c7362e75da)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:45.928842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:45.994490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68395f-2f67-404d-8b0a-d04ad30e0cd9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:45.999470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b21e0a723f74496a1d6a5c7362e75da', 'request_id': 'req-8980f19e-c161-4210-90af-e484ab1a1659'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.010429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b21e0a723f74496a1d6a5c7362e75da', 'request_id': 'req-8980f19e-c161-4210-90af-e484ab1a1659'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.037034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b21e0a723f74496a1d6a5c7362e75da', 'request_id': 'req-8980f19e-c161-4210-90af-e484ab1a1659'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.050536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] The token cache is being invalidate because project 3b21e0a723f74496a1d6a5c7362e75da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:46.050734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.051399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8980f19e-c161-4210-90af-e484ab1a1659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.053238 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1067/2122] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:45 2022] DELETE /identity/v3/projects/3b21e0a723f74496a1d6a5c7362e75da => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:46.058543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9c64-e2cb-43e5-9059-07d6b2b159fe None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.058918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9c64-e2cb-43e5-9059-07d6b2b159fe None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.059393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9c64-e2cb-43e5-9059-07d6b2b159fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.068577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.069483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.069759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.070070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] PATH_INFO: `/v3/projects/36836625a6dc41768ef872810e6892de` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.073797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=36836625a6dc41768ef872810e6892de)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.076282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.086651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a05b9c64-e2cb-43e5-9059-07d6b2b159fe None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:46.088359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a05b9c64-e2cb-43e5-9059-07d6b2b159fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:46.099634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1068/2123] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:46.109670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.110212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.110627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.131298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:46.132819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:46.172117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36836625a6dc41768ef872810e6892de', 'request_id': 'req-13824e8f-bf5b-4a46-9842-9c1d37a199ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.184495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36836625a6dc41768ef872810e6892de', 'request_id': 'req-13824e8f-bf5b-4a46-9842-9c1d37a199ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.191702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36836625a6dc41768ef872810e6892de', 'request_id': 'req-13824e8f-bf5b-4a46-9842-9c1d37a199ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.210572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] The token cache is being invalidate because project 36836625a6dc41768ef872810e6892de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:46.210865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.211550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.217233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1056/2124] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:45 2022] DELETE /identity/v3/projects/36836625a6dc41768ef872810e6892de => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:46.218284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.219735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:46.250328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1069/2125] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:46.251823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.267561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:46.268656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd38dd6-a89c-4233-ad04-e679236aaeb3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.276030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.276772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.277107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.277425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.278919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:46.279284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.281007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.285350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:46.303344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1070/2126] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:46.304214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.314249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e257e-6269-4a79-9455-79d9d4d6792f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.319222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824e8f-bf5b-4a46-9842-9c1d37a199ec admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.319543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.320613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.320899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.321185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.321876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.324296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.340171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.342131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.342577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.343448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] PATH_INFO: `/v3/users/1b3d1cb3248f483d8c839f69d556079f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.345428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3d1cb3248f483d8c839f69d556079f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.347929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.371878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1071/2127] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:46 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:46.373791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.420583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3d1cb3248f483d8c839f69d556079f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.436322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3d1cb3248f483d8c839f69d556079f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.452351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3d1cb3248f483d8c839f69d556079f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.455826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3d1cb3248f483d8c839f69d556079f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.474520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3d1cb3248f483d8c839f69d556079f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:46.492602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1057/2128] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:46 2022] DELETE /identity/v3/users/1b3d1cb3248f483d8c839f69d556079f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:46.507720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc06f5-1429-49da-9f4c-ebc4aa7edd23 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.598134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.599387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.599836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.600542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.601401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.604338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.637151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1072/2129] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:46 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:46.657301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.660455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:46.677822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843138-c648-4a91-8ad4-a75e42b9a2a6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.683035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.683746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.684068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.684865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.685640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.687301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.707930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1058/2130] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:46.712673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.724958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bedc5a-d23f-4833-a1ab-221499f28570 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.729974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951437de-2aba-4ed4-b3e8-77336a84acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.730663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951437de-2aba-4ed4-b3e8-77336a84acf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.730953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951437de-2aba-4ed4-b3e8-77336a84acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.731257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951437de-2aba-4ed4-b3e8-77336a84acf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.732051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951437de-2aba-4ed4-b3e8-77336a84acf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.733705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951437de-2aba-4ed4-b3e8-77336a84acf8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.745057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1073/2131] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:46.756819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.770901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a89b-48e2-40da-bd52-5b4523308f53 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.779163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.783497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.784240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.784875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] PATH_INFO: `/v3/projects/394518477d1442919030fac1c06d925a/users/a3374cb65f1447b8a6305d3c4d84d0df/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.805439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394518477d1442919030fac1c06d925a, user_id=a3374cb65f1447b8a6305d3c4d84d0df, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.808250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.826443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1059/2132] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:46 2022] PUT /identity/v3/projects/394518477d1442919030fac1c06d925a/users/a3374cb65f1447b8a6305d3c4d84d0df/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:46.838384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.838917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.839424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.848440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.850145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:46.881979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] MFA Rules not processed for user `a3374cb65f1447b8a6305d3c4d84d0df`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:46.883265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:46.931680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87c07-857d-46d2-a4f2-2fca10fd2a10 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:46.937828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:46.941134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:46.941134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:46.941134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] PATH_INFO: `/v3/projects/845bd45b6ad544a9a59f59019bf2fe58` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:46.941134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] RBAC: Authorizing `identity:delete_project(project_id=845bd45b6ad544a9a59f59019bf2fe58)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:46.949109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:46.951591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:46.960009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:46.981550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1074/2133] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:46.993346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:46.994913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:47.008428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845bd45b6ad544a9a59f59019bf2fe58', 'request_id': 'req-56d1cf16-2e95-4125-9316-6bb7d53b968a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:47.016231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845bd45b6ad544a9a59f59019bf2fe58', 'request_id': 'req-56d1cf16-2e95-4125-9316-6bb7d53b968a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:47.024538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845bd45b6ad544a9a59f59019bf2fe58', 'request_id': 'req-56d1cf16-2e95-4125-9316-6bb7d53b968a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:47.045654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] The token cache is being invalidate because project 845bd45b6ad544a9a59f59019bf2fe58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:47.046033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:47.046816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56d1cf16-2e95-4125-9316-6bb7d53b968a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:47.049002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1060/2134] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:46 2022] DELETE /identity/v3/projects/845bd45b6ad544a9a59f59019bf2fe58 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:47.056419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79817a-5065-4f00-86db-0cac5d63da43 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.057041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79817a-5065-4f00-86db-0cac5d63da43 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.057438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79817a-5065-4f00-86db-0cac5d63da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.073474 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e192d5-3a2a-4d90-85b3-e9d30d1e4606 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.079516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4c79817a-5065-4f00-86db-0cac5d63da43 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:47.080793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4c79817a-5065-4f00-86db-0cac5d63da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:47.142338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.143326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.143707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.144106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.146211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:47.155513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1061/2135] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:47.165967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.166252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.166533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.189682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:47.190966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:47.202093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1062/2136] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:47.206478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.216706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24fda-e37d-4952-8904-54cf8554f7fe None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.222020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.222698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.222833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.223009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.223252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.224098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:47.224409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.224597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.235605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.235827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1075/2137] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:05:47.252170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1063/2138] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:05:47.253602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.267599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868f86-991b-4991-8fa9-f35dfcd49601 service glance] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.272313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.272985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.273326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.273524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.274213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.276208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.329806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1076/2139] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/projects => generated 409 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:47.334630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.351222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6cef-08ae-466e-9ed8-2db2073cf8da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.438476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.439164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.439444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.440117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.440457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.442420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.468319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1064/2140] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/users => generated 305 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:47.472156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.483787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccacab3-1a0d-429b-99fc-0ae08ec2b3b1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.488487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.489144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.489422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.489693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.490446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.492087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.503731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1077/2141] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:47.508232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.518963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862daed5-e5f2-462f-b9fb-736ef1fceb8e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.523991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ae00-4e8b-4d0a-8cef-85bfc5c1dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.524800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ae00-4e8b-4d0a-8cef-85bfc5c1dd2d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.525084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ae00-4e8b-4d0a-8cef-85bfc5c1dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.525362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ae00-4e8b-4d0a-8cef-85bfc5c1dd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.526094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ae00-4e8b-4d0a-8cef-85bfc5c1dd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.527721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ae00-4e8b-4d0a-8cef-85bfc5c1dd2d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.539041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1065/2142] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:47.544405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.555337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955793-de30-4fce-a075-7c3673bb7990 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.560967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.561871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.562154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.562428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] PATH_INFO: `/v3/projects/3538fab40bf24e96ab24b4971469632b/users/f7d9e04c28bf40d5b47c75226149667c/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.578098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3538fab40bf24e96ab24b4971469632b, user_id=f7d9e04c28bf40d5b47c75226149667c, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.580835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.596299 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1078/2143] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:47 2022] PUT /identity/v3/projects/3538fab40bf24e96ab24b4971469632b/users/f7d9e04c28bf40d5b47c75226149667c/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:47.608891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.609230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.609456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.616396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:47.643212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] MFA Rules not processed for user `f7d9e04c28bf40d5b47c75226149667c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:47.644570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:47.731205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1066/2144] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:47.735659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.740409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:47.841893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9099-ad82-44b2-b1a1-2ea85eeee7a6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.847446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.848179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.848464 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.848765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.849828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.851807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.880315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1079/2145] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:47.884623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:47.897430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2af6b-4471-4373-87c5-88556f8205fa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:47.958281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:47.958962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:47.959261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:47.959533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:47.960268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:47.962243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:47.984119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1067/2146] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:47 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:47.988534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:48.000282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02949ded-bd15-4390-a008-62b76464da29 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:48.005186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:48.005887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.006202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.006475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.007196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:48.008842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:48.020655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1080/2147] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:48.026128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:48.038137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fb794-bc44-4652-88cf-2831b7ca68b8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:48.043223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:48.044293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.044578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.044859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] PATH_INFO: `/v3/projects/9cb225d92da64a6f9bb7b9c3fad31181/users/2c2c42672cc84e0abdb5010111efc0ab/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.062683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb225d92da64a6f9bb7b9c3fad31181, user_id=2c2c42672cc84e0abdb5010111efc0ab, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:48.065448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:48.082397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1068/2148] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:48 2022] PUT /identity/v3/projects/9cb225d92da64a6f9bb7b9c3fad31181/users/2c2c42672cc84e0abdb5010111efc0ab/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:48.086735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:48.098548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009986-5362-4eb8-b00b-d07320400ca2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:48.162147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f22d5d-121c-45e2-9e7d-78f71ddbb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:48.162736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f22d5d-121c-45e2-9e7d-78f71ddbb8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.163022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f22d5d-121c-45e2-9e7d-78f71ddbb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.163300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f22d5d-121c-45e2-9e7d-78f71ddbb8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.164068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f22d5d-121c-45e2-9e7d-78f71ddbb8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:48.165967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f22d5d-121c-45e2-9e7d-78f71ddbb8aa admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:48.176368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1081/2149] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:05:48.180812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:48.192633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39577060-0645-4268-87b4-685c8da2e9e5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:48.197416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:48.198314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.198597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.198876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] PATH_INFO: `/v3/projects/9cb225d92da64a6f9bb7b9c3fad31181/users/2c2c42672cc84e0abdb5010111efc0ab/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.201465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb225d92da64a6f9bb7b9c3fad31181, user_id=2c2c42672cc84e0abdb5010111efc0ab, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:48.204178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:48.216780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1069/2150] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:48 2022] PUT /identity/v3/projects/9cb225d92da64a6f9bb7b9c3fad31181/users/2c2c42672cc84e0abdb5010111efc0ab/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:48.227424 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.227713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.228034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.256398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] MFA Rules not processed for user `2c2c42672cc84e0abdb5010111efc0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:48.257616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:48.343784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:48.349952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1082/2151] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:48.361058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:48.362802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:48.432492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:48.456096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d412-9ea2-45fd-9628-e997072d63e3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:48.460324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:48.461051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.461363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.461704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.473533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:48.475009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:48.487974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1070/2152] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:48.671876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:48.683412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda488-0bc5-4b43-8645-518e38fe7bcb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:48.689889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:48.690708 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:48.690826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:48.691098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:48.757324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:48.758823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:48.768685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1083/2153] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:52.240542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:52.242258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:52.346495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf07c-6be1-4bdd-8552-b037f3cecbb7 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:52.351954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:52.352889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:52.353320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:52.353610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] PATH_INFO: `/v3/users/25fb4e59d5414fe9a2772469e9a956b5` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:52.354900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fb4e59d5414fe9a2772469e9a956b5)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:52.356982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:52.411163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fb4e59d5414fe9a2772469e9a956b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.425518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fb4e59d5414fe9a2772469e9a956b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.433266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fb4e59d5414fe9a2772469e9a956b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.434057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fb4e59d5414fe9a2772469e9a956b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.448874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3d9102d5-01e6-4982-9dc9-03c4b8321fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fb4e59d5414fe9a2772469e9a956b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.456572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1071/2154] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:52 2022] DELETE /identity/v3/users/25fb4e59d5414fe9a2772469e9a956b5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:52.685072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:52.697550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128ac11-f47d-42fd-bd7d-e946c8372243 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:52.770040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:52.770838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:52.771122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:52.771396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] PATH_INFO: `/v3/projects/f719985a98db414f873a2620b1ba980b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:52.772702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f719985a98db414f873a2620b1ba980b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:52.774681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:52.829985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f719985a98db414f873a2620b1ba980b', 'request_id': 'req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.836010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f719985a98db414f873a2620b1ba980b', 'request_id': 'req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.843875 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f719985a98db414f873a2620b1ba980b', 'request_id': 'req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.855398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] The token cache is being invalidate because project f719985a98db414f873a2620b1ba980b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:52.855690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.856413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8cf40f44-6f56-4dd1-8d58-1bb424c7ac6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:52.858175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1084/2155] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:52 2022] DELETE /identity/v3/projects/f719985a98db414f873a2620b1ba980b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:52.863570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:52.863896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:52.864182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:52.883709 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:52.884983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:52.951593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1072/2156] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:52.960985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:52.961269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:52.961547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:52.983660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:52.984929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:52.993318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1085/2157] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:52.998192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.008634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1a056-277b-4cdf-b486-61031049490f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.013775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.014462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.014744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.015018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.015782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:05:53.016095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.017740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.019529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:53.034728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1073/2158] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:05:53.040276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.054610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23894c69-bd39-40e7-8438-66ecba709e52 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.061656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.062437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.062724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.062996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.063710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.065731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.087711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:53.097435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1086/2159] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:05:53 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:05:53.101889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.115634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc44cfd-df01-405c-8ede-67efe6a2cf14 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.196918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.197614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.197880 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.198152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.198863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.200871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.222071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1074/2160] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:05:53 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:05:53.227926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.248817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d558dfb-fe6e-4bca-ac51-27a8649709c6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.256795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.257971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.258481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.258995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.260444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.263605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.285080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1087/2161] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:53.289458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.306331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455806-023a-48f4-9d88-9dc3f214390d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.311098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd564ea-0b96-4131-b164-51fac5d23f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.311809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd564ea-0b96-4131-b164-51fac5d23f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.312100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd564ea-0b96-4131-b164-51fac5d23f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.312377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd564ea-0b96-4131-b164-51fac5d23f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.313112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd564ea-0b96-4131-b164-51fac5d23f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.314750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd564ea-0b96-4131-b164-51fac5d23f9a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.327415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1075/2162] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:05:53.334085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.350751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785631-c41c-4b1a-9b96-957082ce2d34 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.358018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.358936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.359218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.359493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] PATH_INFO: `/v3/projects/74e85f2b75a14a31ac1498fa9ac1d243/users/3d8fbafbd63c4e1c946b414e2842eb91/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.390089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e85f2b75a14a31ac1498fa9ac1d243, user_id=3d8fbafbd63c4e1c946b414e2842eb91, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.396040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.422604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1088/2163] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:05:53 2022] PUT /identity/v3/projects/74e85f2b75a14a31ac1498fa9ac1d243/users/3d8fbafbd63c4e1c946b414e2842eb91/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:53.428553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.428881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.429165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.449390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:53.450683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:53.533735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1076/2164] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:53.542747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:53.545439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:53.610172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bd430-2d2e-4c3c-9e24-7665b6b7f651 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:53.614367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163c670-f85d-4537-9bfb-a926fa3daf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:53.615020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163c670-f85d-4537-9bfb-a926fa3daf28 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:53.615302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163c670-f85d-4537-9bfb-a926fa3daf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:53.615576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163c670-f85d-4537-9bfb-a926fa3daf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:53.626074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163c670-f85d-4537-9bfb-a926fa3daf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:53.628003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163c670-f85d-4537-9bfb-a926fa3daf28 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:53.639103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1089/2165] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:58.130899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:58.132544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:58.155683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954f6db-4b10-4b6a-bfc2-ee948ba93127 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:58.167478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:58.168981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:58.169475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:58.169903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] PATH_INFO: `/v3/users/9b2ce8d6365e43bc82834df96d294e86` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:58.171425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2ce8d6365e43bc82834df96d294e86)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:58.173664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:58.295554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2ce8d6365e43bc82834df96d294e86'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:58.363732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2ce8d6365e43bc82834df96d294e86'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:58.369357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:58.400075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2ce8d6365e43bc82834df96d294e86'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:58.402179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2ce8d6365e43bc82834df96d294e86'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:58.424304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2ce8d6365e43bc82834df96d294e86'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:58.442959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1077/2166] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:58 2022] DELETE /identity/v3/users/9b2ce8d6365e43bc82834df96d294e86 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:05:58.445741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8997afb-2117-4fd2-96eb-0d836ee45509 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:58.446512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8997afb-2117-4fd2-96eb-0d836ee45509 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:58.446512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8997afb-2117-4fd2-96eb-0d836ee45509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:58.505715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b8997afb-2117-4fd2-96eb-0d836ee45509 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:58.508646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b8997afb-2117-4fd2-96eb-0d836ee45509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:58.727145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1090/2167] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:05:58.759445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:58.759445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:58.934789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cce4b-f11b-45c4-83b8-da029389ec84 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:58.943737 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08b96-a7c8-41bd-a626-1f7fecfc2546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:58.944450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08b96-a7c8-41bd-a626-1f7fecfc2546 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:58.944744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08b96-a7c8-41bd-a626-1f7fecfc2546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:58.945025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08b96-a7c8-41bd-a626-1f7fecfc2546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:58.996453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08b96-a7c8-41bd-a626-1f7fecfc2546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:58.998129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08b96-a7c8-41bd-a626-1f7fecfc2546 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:59.022186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1078/2168] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:59.312566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:59.312566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:59.312566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:59.345613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] MFA Rules not processed for user `3d8fbafbd63c4e1c946b414e2842eb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:59.347141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:59.425574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:59.452706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1091/2169] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:59.464726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:59.466868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:59.467608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:59.489367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] MFA Rules not processed for user `3d8fbafbd63c4e1c946b414e2842eb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:05:59.490736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:59.499189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1079/2170] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:05:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:05:59.510270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:59.519208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:59.551413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:59.554598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:59.583601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c72145-ea71-4f43-9f79-e523a0b44724 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:59.594772 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:59.595954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:59.596386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:59.596862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] PATH_INFO: `/v3/projects/e231d688eabe463a8e927de9b63006bd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:59.598509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e231d688eabe463a8e927de9b63006bd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:59.602051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:59.655144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4b61-310e-4c04-abd6-b462f28b5ae5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:59.672241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e231d688eabe463a8e927de9b63006bd', 'request_id': 'req-885cea6c-0476-451a-a7c5-399a04a7b43e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.685401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e231d688eabe463a8e927de9b63006bd', 'request_id': 'req-885cea6c-0476-451a-a7c5-399a04a7b43e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.697669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e231d688eabe463a8e927de9b63006bd', 'request_id': 'req-885cea6c-0476-451a-a7c5-399a04a7b43e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.731429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] The token cache is being invalidate because project e231d688eabe463a8e927de9b63006bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:05:59.731946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.733061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.736665 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1080/2171] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:05:59 2022] DELETE /identity/v3/projects/e231d688eabe463a8e927de9b63006bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:05:59.741455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:05:59.748044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:59.783618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:59.784510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:59.784959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:59.785244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:59.788088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:05:59.855024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cea6c-0476-451a-a7c5-399a04a7b43e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:05:59.862320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:05:59.863360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:05:59.863608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:05:59.864031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] PATH_INFO: `/v3/users/1d85838f1a294ddeb257ec5ed7140953` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:05:59.865471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d85838f1a294ddeb257ec5ed7140953)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:59.867550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:59.874069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:05:59.874302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:05:59.877921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:05:59.900576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1092/2172] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:05:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:05:59.949219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d85838f1a294ddeb257ec5ed7140953'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.970648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d85838f1a294ddeb257ec5ed7140953'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.981774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d85838f1a294ddeb257ec5ed7140953'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.982976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d85838f1a294ddeb257ec5ed7140953'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:05:59.997205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c3f02e1f-7a02-4bf5-af03-e03fbb2bda66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d85838f1a294ddeb257ec5ed7140953'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:00.013040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1081/2173] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:05:59 2022] DELETE /identity/v3/users/1d85838f1a294ddeb257ec5ed7140953 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:00.467582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:00.480981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321ee83-e0ba-4704-b48c-3c6a1084b478 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:00.554975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:00.597222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:00.600050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:00.600642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:00.603197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] PATH_INFO: `/v3/projects/5b59d3ac2aae448dba8a0eb7ae3ce679` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:00.606995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b59d3ac2aae448dba8a0eb7ae3ce679)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:00.611269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:00.798738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b59d3ac2aae448dba8a0eb7ae3ce679', 'request_id': 'req-3304af66-da59-4296-9ede-1a272bb6adcc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:00.823169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b59d3ac2aae448dba8a0eb7ae3ce679', 'request_id': 'req-3304af66-da59-4296-9ede-1a272bb6adcc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:00.854319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b59d3ac2aae448dba8a0eb7ae3ce679', 'request_id': 'req-3304af66-da59-4296-9ede-1a272bb6adcc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:00.878796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] The token cache is being invalidate because project 5b59d3ac2aae448dba8a0eb7ae3ce679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:00.879094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:00.880581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3304af66-da59-4296-9ede-1a272bb6adcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:00.882910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1093/2174] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:00 2022] DELETE /identity/v3/projects/5b59d3ac2aae448dba8a0eb7ae3ce679 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:00.890330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1883a-6961-4633-afef-400370867510 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:00.891346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1883a-6961-4633-afef-400370867510 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:00.891819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1883a-6961-4633-afef-400370867510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:00.922879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fbc1883a-6961-4633-afef-400370867510 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:00.927660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fbc1883a-6961-4633-afef-400370867510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:00.969692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:00.975587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:00.976044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.030023 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] MFA Rules not processed for user `3d8fbafbd63c4e1c946b414e2842eb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:01.036163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:01.120780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1082/2175] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:01.134566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.135145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.135566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.182086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:01.183332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:01.209575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1094/2176] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:01.211492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1083/2177] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:01.215837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.252103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4719c-7b85-4a5c-ab53-c42635459905 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.260501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.261914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.262804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.263330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.264635 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:06:01.265502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.268161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.287494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1095/2178] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:06:01.293033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.304086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef15859-f6a7-425d-b457-71c631cba03f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.322170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.327267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.329551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.329551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.329551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.331572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:01.332513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.334576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.361546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5b794-93d7-4087-b214-1d7f38294bd3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.372557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.373854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.374419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.374806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] PATH_INFO: `/v3/users/f7d9e04c28bf40d5b47c75226149667c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.377332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d9e04c28bf40d5b47c75226149667c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.380341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.404809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1084/2179] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:01 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:01.412937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.481698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d9e04c28bf40d5b47c75226149667c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:01.483136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:01.516815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d9e04c28bf40d5b47c75226149667c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:01.520357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d9e04c28bf40d5b47c75226149667c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:01.527233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:01.535404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd57f1-fd76-4f54-ba72-57eaf5ca23aa admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.541838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d9e04c28bf40d5b47c75226149667c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:01.553268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.554795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.555669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.556354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.557473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.561234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.564687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-924db5cd-8968-4fe6-805d-c369f179bb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d9e04c28bf40d5b47c75226149667c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:01.577417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1096/2180] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:01 2022] DELETE /identity/v3/users/f7d9e04c28bf40d5b47c75226149667c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:01.583850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.586168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.586886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.607663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1085/2181] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:01 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:01.611982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.614895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:01.626218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:01.627544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:01.629962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858de1b-0a54-4826-8a3a-5428ca365c15 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.725926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1097/2182] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:01.739728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.740974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:01.742893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.745920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.746915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.747381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.749455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.754059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.779585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1086/2183] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:06:01.781131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.795877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4ff0-806f-44fe-8831-2e539e6e1301 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.803793 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.805460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.806065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.806580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.807499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.809904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.823353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1087/2184] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:01.827738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:01.841340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876d73-2dd1-4d3f-aa9d-436cb1eab7a3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.848171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfbe6d-274a-438e-950a-f2ae1aa5aa39 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:01.854586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.857542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.858093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.858502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] PATH_INFO: `/v3/projects/11e1ee2059a34c6d9ccab62ca68340cd/users/9a3a596e020844da970b3076246c7c9a/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.858670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87257-b6f7-4df8-be0a-0b13a923d834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:01.859369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87257-b6f7-4df8-be0a-0b13a923d834 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.859655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87257-b6f7-4df8-be0a-0b13a923d834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.860124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87257-b6f7-4df8-be0a-0b13a923d834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:01.875861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c87257-b6f7-4df8-be0a-0b13a923d834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.877402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c87257-b6f7-4df8-be0a-0b13a923d834 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.879682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e1ee2059a34c6d9ccab62ca68340cd, user_id=9a3a596e020844da970b3076246c7c9a, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:01.883812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:01.907203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1098/2185] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:06:01.910941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1088/2186] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:01 2022] PUT /identity/v3/projects/11e1ee2059a34c6d9ccab62ca68340cd/users/9a3a596e020844da970b3076246c7c9a/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:01.925508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:01.926074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:01.926800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:02.058855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] MFA Rules not processed for user `9a3a596e020844da970b3076246c7c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:02.063738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:02.271104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:02.307025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1099/2187] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:02.307464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:02.602517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:02.605499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:02.728987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff46b0-bbe2-490c-91ce-e7c2771dc90f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:02.791364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:02.791954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:02.792457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:02.799180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:02.801105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:02.828499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949076e-7bb0-4a79-998d-3b38db01f9ce None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:02.840293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:02.841340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:02.841555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:02.841834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] PATH_INFO: `/v3/projects/3538fab40bf24e96ab24b4971469632b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:02.844980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3538fab40bf24e96ab24b4971469632b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:02.848074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:02.852276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:02.925089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1089/2188] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:02 2022] POST /identity/v3/projects => generated 381 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:02.930843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:02.939712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3538fab40bf24e96ab24b4971469632b', 'request_id': 'req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:02.951194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3538fab40bf24e96ab24b4971469632b', 'request_id': 'req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:02.970851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3538fab40bf24e96ab24b4971469632b', 'request_id': 'req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:02.999005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] The token cache is being invalidate because project 3538fab40bf24e96ab24b4971469632b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:02.999005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.000389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.002762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1100/2189] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:02 2022] DELETE /identity/v3/projects/3538fab40bf24e96ab24b4971469632b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:03.009675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:03.011521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:03.012854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:03.079294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13df78c-1468-49e7-8b8a-4b828abd3973 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:03.097450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:03.099544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:03.100365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:03.100365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:03.102935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:03.109882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:03.164279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1090/2190] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:02 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:03.170712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:03.174566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:03.222352 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c9217-2511-45a3-a2a5-6f2e42a21c9b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:03.228538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7b6c3-c2e2-4446-9cde-11e81dd93ffe admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:03.237401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:03.238150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:03.238440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:03.239315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:03.240129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:03.243386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:03.244338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:03.244623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:03.245633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:03.246054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] PATH_INFO: `/v3/users/2c2c42672cc84e0abdb5010111efc0ab` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:03.250248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2c42672cc84e0abdb5010111efc0ab)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:03.253548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:03.276122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1091/2191] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:03.329711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:03.357392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3b73-f4f5-477a-9dd0-4fe010c374a4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:03.377770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:03.395329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:03.397033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:03.400216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:03.400804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] PATH_INFO: `/v3/projects/5c28a162618049a98f5b554bec4bba99/users/77b601668c454e12bfbdcbf10bf27821/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:03.441725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2c42672cc84e0abdb5010111efc0ab'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.477064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c28a162618049a98f5b554bec4bba99, user_id=77b601668c454e12bfbdcbf10bf27821, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:03.489489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:03.498745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2c42672cc84e0abdb5010111efc0ab'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.500346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2c42672cc84e0abdb5010111efc0ab'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.519219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2c42672cc84e0abdb5010111efc0ab'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.542068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1092/2192] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:03 2022] PUT /identity/v3/projects/5c28a162618049a98f5b554bec4bba99/users/77b601668c454e12bfbdcbf10bf27821/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:03.546330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2c42672cc84e0abdb5010111efc0ab'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:03.547134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:03.551382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:03.556947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1101/2193] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:03 2022] DELETE /identity/v3/users/2c2c42672cc84e0abdb5010111efc0ab => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:03.876872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d557c1-26b7-43a6-a6f1-c73aab32e935 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:04.073975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210399-4689-4901-8457-f41ef5611259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:04.075666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210399-4689-4901-8457-f41ef5611259 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:04.076096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210399-4689-4901-8457-f41ef5611259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:04.076952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210399-4689-4901-8457-f41ef5611259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:04.078114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210399-4689-4901-8457-f41ef5611259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:04.097506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210399-4689-4901-8457-f41ef5611259 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:04.114727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1093/2194] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:04.120186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:04.142024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adffaf-b7cd-4971-bd20-7f13160a43f6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:04.152436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:04.155817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:04.156736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:04.157492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] PATH_INFO: `/v3/projects/5c28a162618049a98f5b554bec4bba99/users/77b601668c454e12bfbdcbf10bf27821/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:04.162555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c28a162618049a98f5b554bec4bba99, user_id=77b601668c454e12bfbdcbf10bf27821, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:04.170275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:04.196865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1102/2195] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:04 2022] PUT /identity/v3/projects/5c28a162618049a98f5b554bec4bba99/users/77b601668c454e12bfbdcbf10bf27821/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:04.207518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:04.208587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:04.209354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:04.279275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] MFA Rules not processed for user `77b601668c454e12bfbdcbf10bf27821`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:04.281768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:04.324197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:04.521546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:04.524846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:04.525967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1094/2196] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:04.541419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:04.542944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:04.637875 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336b4ce-80ff-487d-a19c-d4d760c92991 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:04.642896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:04.656037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:04.658533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:04.659080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:04.681890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:04.686394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:04.719679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594fd1-bbd0-4d7f-ab92-9a4766b764bb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:04.720881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1095/2197] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:06:04.726912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:04.727848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:04.728339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:04.728626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] PATH_INFO: `/v3/projects/9cb225d92da64a6f9bb7b9c3fad31181` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:04.730118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb225d92da64a6f9bb7b9c3fad31181)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:04.733732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:04.844527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb225d92da64a6f9bb7b9c3fad31181', 'request_id': 'req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:04.862053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb225d92da64a6f9bb7b9c3fad31181', 'request_id': 'req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:04.881141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb225d92da64a6f9bb7b9c3fad31181', 'request_id': 'req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:04.953661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:04.994583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] The token cache is being invalidate because project 9cb225d92da64a6f9bb7b9c3fad31181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:04.994928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:04.997777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9eb2f7b5-712d-4f53-b9a9-c94bdd1a473c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:04.998438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19517d-e418-43b8-9dcb-d1a5fb5ce668 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.002223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1103/2198] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:04 2022] DELETE /identity/v3/projects/9cb225d92da64a6f9bb7b9c3fad31181 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:05.012321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755562dd-4ad3-4483-bcca-98273c038ef9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.012607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755562dd-4ad3-4483-bcca-98273c038ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.012882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755562dd-4ad3-4483-bcca-98273c038ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.056590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-755562dd-4ad3-4483-bcca-98273c038ef9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:05.058092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-755562dd-4ad3-4483-bcca-98273c038ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:05.120082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:05.135914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.138712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.139284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.139963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.143879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:05.233461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1104/2199] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:05.234662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.234950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.235224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.265421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:05.267891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:05.286965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.288769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0b321-2ddd-4865-b603-a78ed16c1bb3 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.303596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1096/2200] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:05.305027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.305602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.305966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.329380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:05.330929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:05.346799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1097/2201] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:05.352669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:05.358563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:05.364388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1105/2202] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:06:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:05.367926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb91df-8eb3-49eb-9a6f-a54a6f2b8e2c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.383402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.384151 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.385349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.385349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.386253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:06:05.386505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.388804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.430738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:05.433198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:05.447631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1098/2203] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:06:05.451347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:05.466370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749851-ada5-4aaf-b582-4f13e2180ed1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.472169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.473620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.473928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.474216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.475055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.477451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.521526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1099/2204] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:05 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:05.527920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:05.567389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be95cc-6844-4005-8b5f-9f392b33027f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.661727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.662063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.662355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.662668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.681340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:05.742441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a378b3-caaa-44ce-9848-780b690519ef admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.756530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.757502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.757790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.759279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.762562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.767375 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.770955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.773903 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.797409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1106/2205] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:06:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 09:06:05.819574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1100/2206] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:05 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:05.823406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:05.848873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5616b-aa3c-40d3-a365-1b830ab27d58 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.858591 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.859784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.860505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.860784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.861746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.864643 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.894111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1107/2207] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:05.898659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:05.917441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d4a4-f341-4e4f-90a0-23f2cb802121 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:05.938402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56171f56-1b90-4e32-a552-3cdb69b876e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:05.939792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171f56-1b90-4e32-a552-3cdb69b876e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:05.940199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171f56-1b90-4e32-a552-3cdb69b876e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:05.940728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171f56-1b90-4e32-a552-3cdb69b876e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:05.941604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56171f56-1b90-4e32-a552-3cdb69b876e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:05.946430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56171f56-1b90-4e32-a552-3cdb69b876e0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:05.970476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1101/2208] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:05.974468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:06.023276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca8e4-d306-4e66-91e5-d9f06d8e7fa9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:06.036928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:06.037888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:06.038865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:06.038865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] PATH_INFO: `/v3/projects/9130bdda8396436b9f42db76ead72fdb/users/f96ab657f9b34c0b8f006f249f1b79fa/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:06.069881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9130bdda8396436b9f42db76ead72fdb, user_id=f96ab657f9b34c0b8f006f249f1b79fa, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:06.073132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:06.113275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1108/2209] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:05 2022] PUT /identity/v3/projects/9130bdda8396436b9f42db76ead72fdb/users/f96ab657f9b34c0b8f006f249f1b79fa/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:06.114790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac471c7-6c3d-4816-a136-6748ac6a255b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:06.115089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac471c7-6c3d-4816-a136-6748ac6a255b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:06.115505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac471c7-6c3d-4816-a136-6748ac6a255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:06.163088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6ac471c7-6c3d-4816-a136-6748ac6a255b None None] MFA Rules not processed for user `f96ab657f9b34c0b8f006f249f1b79fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:06.164500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ac471c7-6c3d-4816-a136-6748ac6a255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:06.407851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1102/2210] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:06.437211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:06.440000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:06.680271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36afdc-d05c-48f0-acb6-9156d6a70ee4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:06.691870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:06.692566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:06.692864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:06.693141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:06.715934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:06.721743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:06.758134 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1109/2211] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:06.937637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae2fd-3bb7-4d8b-a0e8-5eaf59b78d82 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:06.938017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae2fd-3bb7-4d8b-a0e8-5eaf59b78d82 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:06.938439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae2fd-3bb7-4d8b-a0e8-5eaf59b78d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:06.973950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-345ae2fd-3bb7-4d8b-a0e8-5eaf59b78d82 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:06.975541 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-345ae2fd-3bb7-4d8b-a0e8-5eaf59b78d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:07.078249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:07.158259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:07.172883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1103/2212] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 09:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:07.323798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dac274-912f-4a61-b4ed-9968a923da8b service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:07.338980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:07.341616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:07.342409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:07.342800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:07.354849 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:07.356633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:07.377831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1110/2213] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:06:07.931682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3093b-4a77-413a-a69f-83517d871709 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:07.932117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3093b-4a77-413a-a69f-83517d871709 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:07.932520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3093b-4a77-413a-a69f-83517d871709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:07.959069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f3b3093b-4a77-413a-a69f-83517d871709 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:07.959069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f3b3093b-4a77-413a-a69f-83517d871709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:07.967165 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1104/2214] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:07.981898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:08.003837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79ec1-e820-489a-880f-8140f7c97036 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:08.016581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:08.017501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:08.017952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:08.018296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:08.038304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:08.040472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:08.045111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:08.054307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1111/2215] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:06:08.573816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:08.574757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:08.575043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:08.600242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:08.601621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:08.611333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1105/2216] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:08.627998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:08.636301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1953-9674-43e2-bc36-febf1e76005a service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:08.641838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379a40b-5023-4b8a-ac70-ac60c5d8c49c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:08.642506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379a40b-5023-4b8a-ac70-ac60c5d8c49c service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:08.642783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379a40b-5023-4b8a-ac70-ac60c5d8c49c service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:08.643060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379a40b-5023-4b8a-ac70-ac60c5d8c49c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:08.652796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379a40b-5023-4b8a-ac70-ac60c5d8c49c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:08.654685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379a40b-5023-4b8a-ac70-ac60c5d8c49c service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:08.663969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1112/2217] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:06:18.591964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=14 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:18.660459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:20.441228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:20.442677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:20.507745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1f2d-9101-4798-ae12-407743c9ff5f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:20.512293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:20.513815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:20.514102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:20.514376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] PATH_INFO: `/v3/users/f3a1e4c97d634eb88e454f9e36424d45` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:20.515606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a1e4c97d634eb88e454f9e36424d45)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:20.517635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:20.610062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a1e4c97d634eb88e454f9e36424d45'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:20.625452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a1e4c97d634eb88e454f9e36424d45'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:20.637528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a1e4c97d634eb88e454f9e36424d45'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:20.639190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a1e4c97d634eb88e454f9e36424d45'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:20.660113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a1e4c97d634eb88e454f9e36424d45'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:20.682516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:20.683379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:20.683949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:20.686309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1106/2218] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:20 2022] DELETE /identity/v3/users/f3a1e4c97d634eb88e454f9e36424d45 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:20.714988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:20.716637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:20.867897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1113/2219] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:20.884841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:20.886882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:21.011474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebd77-f87c-4e52-b51f-c987033c456f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:21.021094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:21.022372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:21.022697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:21.023026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:21.062308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:21.071260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:21.105955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1107/2220] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:06:21.590545 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:21.593077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:21.607048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569699dc-caa7-4f9d-a666-bdd6d50a0252 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:21.612810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:21.613994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:21.614508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:21.614994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] PATH_INFO: `/v3/projects/e1843cdd14b54fd18d9c4623343ed5f7` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:21.617227 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1843cdd14b54fd18d9c4623343ed5f7)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:21.620118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:21.728461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1843cdd14b54fd18d9c4623343ed5f7', 'request_id': 'req-2b0e844c-ab78-4267-8a97-258432a38c67'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:21.735598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1843cdd14b54fd18d9c4623343ed5f7', 'request_id': 'req-2b0e844c-ab78-4267-8a97-258432a38c67'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:21.749427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1843cdd14b54fd18d9c4623343ed5f7', 'request_id': 'req-2b0e844c-ab78-4267-8a97-258432a38c67'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:21.763554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] The token cache is being invalidate because project e1843cdd14b54fd18d9c4623343ed5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:21.763913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:21.764595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2b0e844c-ab78-4267-8a97-258432a38c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:21.766144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1114/2221] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:21 2022] DELETE /identity/v3/projects/e1843cdd14b54fd18d9c4623343ed5f7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:22.164510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:22.166234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:22.179591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859106-cadc-41f9-b751-a8ca13bd389c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:22.198915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:22.240683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:22.241570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:22.241852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:22.242179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] PATH_INFO: `/v3/users/f96ab657f9b34c0b8f006f249f1b79fa` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:22.243323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96ab657f9b34c0b8f006f249f1b79fa)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:22.245314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:22.293587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96ab657f9b34c0b8f006f249f1b79fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.307783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96ab657f9b34c0b8f006f249f1b79fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.317067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96ab657f9b34c0b8f006f249f1b79fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.317859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96ab657f9b34c0b8f006f249f1b79fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.325904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96ab657f9b34c0b8f006f249f1b79fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.335967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1108/2222] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:22 2022] DELETE /identity/v3/users/f96ab657f9b34c0b8f006f249f1b79fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:22.338278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:22.338564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:22.338840 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:22.359077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:22.361687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:22.452435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1115/2223] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:22.463077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:22.464547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:22.553481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142556-9ec5-4ec1-9e6c-7880869da653 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:22.557391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeed6b0-9e4a-4337-800f-7a7da277e814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:22.558250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed6b0-9e4a-4337-800f-7a7da277e814 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:22.558675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed6b0-9e4a-4337-800f-7a7da277e814 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:22.559110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed6b0-9e4a-4337-800f-7a7da277e814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:22.571373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeed6b0-9e4a-4337-800f-7a7da277e814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:22.572898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeed6b0-9e4a-4337-800f-7a7da277e814 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:22.584638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1109/2224] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:22.877174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:22.880359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:22.895595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7d89-65f3-417c-8e3c-bf80ab8f8bcf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:22.902259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:22.904347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:22.904843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:22.905392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] PATH_INFO: `/v3/projects/9130bdda8396436b9f42db76ead72fdb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:22.906962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9130bdda8396436b9f42db76ead72fdb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:22.908859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:22.941459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:22.971582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9130bdda8396436b9f42db76ead72fdb', 'request_id': 'req-eddfc00a-4d1e-4732-9cca-6684a4a88056'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.977300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9130bdda8396436b9f42db76ead72fdb', 'request_id': 'req-eddfc00a-4d1e-4732-9cca-6684a4a88056'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.985554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9130bdda8396436b9f42db76ead72fdb', 'request_id': 'req-eddfc00a-4d1e-4732-9cca-6684a4a88056'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.997661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] The token cache is being invalidate because project 9130bdda8396436b9f42db76ead72fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:22.998054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:22.998771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-eddfc00a-4d1e-4732-9cca-6684a4a88056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:23.000435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1116/2225] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:22 2022] DELETE /identity/v3/projects/9130bdda8396436b9f42db76ead72fdb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:23.005292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.005584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.005883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.025480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:23.026718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:23.070098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:23.091903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1110/2226] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:23.100787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.101078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.101354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.120921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:23.122122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:23.130910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1117/2227] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:23.135539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.146617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebdf07-0dd4-4ef9-b5e6-32439e2ab026 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.151653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.152393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.152756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.153056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.154554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:06:23.154874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.156670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.169397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1111/2228] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:06:23.173515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.182848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4d0e1-3d48-4909-998c-e86ba2b82ec6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.187528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.188203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.188484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.188753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.189427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.191365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.218126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1118/2229] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:23.222323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.232511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c9bd3-7eb5-467b-89b1-f9573a3c3b51 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.292746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.293513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.293822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.294082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.294802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.296972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.323719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1112/2230] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:23.332998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.344284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d999bf6-05e6-49ca-afee-6c3129a6a033 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.349198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.350143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.350438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.350718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.351446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.354835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.365431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1119/2231] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:06:23.369341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.380190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09c2eb-233a-4536-bc1a-b75c168417ac admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.384798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4169401-fd5b-43b0-b368-8137c0ea0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.385453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169401-fd5b-43b0-b368-8137c0ea0525 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.385736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169401-fd5b-43b0-b368-8137c0ea0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.386011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169401-fd5b-43b0-b368-8137c0ea0525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.386739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4169401-fd5b-43b0-b368-8137c0ea0525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.389057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4169401-fd5b-43b0-b368-8137c0ea0525 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.398963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1113/2232] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:23.403051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.412967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480880-392d-4372-878e-1d0aa5ed3857 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.417856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.418740 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.419054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.419328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] PATH_INFO: `/v3/projects/67b22ff9e9374d9fab01292e0f40a714/users/f47ba07e8a3f4cb99626bd19a814cce1/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.434065 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b22ff9e9374d9fab01292e0f40a714, user_id=f47ba07e8a3f4cb99626bd19a814cce1, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.437390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.451168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1120/2233] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:23 2022] PUT /identity/v3/projects/67b22ff9e9374d9fab01292e0f40a714/users/f47ba07e8a3f4cb99626bd19a814cce1/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:23.461287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.461578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.461855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.488150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] MFA Rules not processed for user `f47ba07e8a3f4cb99626bd19a814cce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:23.489355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:23.552794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1114/2234] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:23.557244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.625552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4ee1-b2e9-423a-8485-983a8a0038f3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.630283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.630939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.631309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.631497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.632293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.634175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.662221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1121/2235] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:23.666784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.678736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cda747-ac89-47fb-b414-69aa91bc632f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.722378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:23.749610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.750297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.750650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.750907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.751562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.753657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.781080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1115/2236] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:23 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:23.782444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.796579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38883c-64ca-4c71-b617-e113062e6465 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.803321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.803586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.812650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.812650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.812650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.812650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.821821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1122/2237] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:06:23.826581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.837031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ee4-38ad-4161-8533-7d52bbec578b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.843198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.844153 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.844441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.844720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] PATH_INFO: `/v3/projects/a08bb8b881764a0c8212e4db5fd24b21/users/4486c3e1112e42259474f9130e9a42d4/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.861831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08bb8b881764a0c8212e4db5fd24b21, user_id=4486c3e1112e42259474f9130e9a42d4, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.864938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.879565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1116/2238] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:23 2022] PUT /identity/v3/projects/a08bb8b881764a0c8212e4db5fd24b21/users/4486c3e1112e42259474f9130e9a42d4/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:23.884014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.894893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94b20-f576-4e45-8573-d0e939bd3586 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.908604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.910478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:23.913651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:23.965600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:23.966939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:23.967224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:23.967499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:23.968369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:23.970028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:23.980859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1123/2239] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:06:23.986449 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:23.995787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc9c2-91a1-4c00-8a71-d071f856f12b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:23.996327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecc391-76f1-46bd-aca0-43a41f9204df admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:24.001814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:24.002698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.002977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.003243 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] PATH_INFO: `/v3/users/9a3a596e020844da970b3076246c7c9a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.003898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a77099-ad41-440e-886f-381225cd9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:24.004452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3a596e020844da970b3076246c7c9a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:24.005467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a77099-ad41-440e-886f-381225cd9216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.006013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a77099-ad41-440e-886f-381225cd9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.006464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:24.006564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a77099-ad41-440e-886f-381225cd9216 admin admin] PATH_INFO: `/v3/projects/a08bb8b881764a0c8212e4db5fd24b21/users/4486c3e1112e42259474f9130e9a42d4/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.009956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a77099-ad41-440e-886f-381225cd9216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08bb8b881764a0c8212e4db5fd24b21, user_id=4486c3e1112e42259474f9130e9a42d4, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:24.012782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a77099-ad41-440e-886f-381225cd9216 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:24.024942 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1124/2240] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:23 2022] PUT /identity/v3/projects/a08bb8b881764a0c8212e4db5fd24b21/users/4486c3e1112e42259474f9130e9a42d4/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:24.038862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.039327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.039579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.064386 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3a596e020844da970b3076246c7c9a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.071891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] MFA Rules not processed for user `4486c3e1112e42259474f9130e9a42d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:24.073133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.078421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3a596e020844da970b3076246c7c9a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.086148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3a596e020844da970b3076246c7c9a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.086987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3a596e020844da970b3076246c7c9a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.095663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9f12acd8-d81e-400b-90be-e8a06bcd7817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3a596e020844da970b3076246c7c9a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.102203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1117/2241] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:23 2022] DELETE /identity/v3/users/9a3a596e020844da970b3076246c7c9a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:24.106834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26504-f468-4177-a995-ccc606181587 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.107155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26504-f468-4177-a995-ccc606181587 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.107434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26504-f468-4177-a995-ccc606181587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.125442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1be26504-f468-4177-a995-ccc606181587 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:24.126661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1be26504-f468-4177-a995-ccc606181587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.146804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:24.162710 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1125/2242] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:24.175078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:24.176254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.202094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1118/2243] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:24.202970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26504-f468-4177-a995-ccc606181587 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:24.204546 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1be26504-f468-4177-a995-ccc606181587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.217426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26504-f468-4177-a995-ccc606181587 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:24.225057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:24.226701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.227211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.227661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] PATH_INFO: `/v3/users/a3374cb65f1447b8a6305d3c4d84d0df` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.229838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3374cb65f1447b8a6305d3c4d84d0df)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:24.233752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:24.244413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436c8e-73d9-4423-b75c-77b06e7621e8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:24.291465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3374cb65f1447b8a6305d3c4d84d0df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.291723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:24.303547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:24.304253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.304533 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.304810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.306260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3374cb65f1447b8a6305d3c4d84d0df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.306614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.315346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3374cb65f1447b8a6305d3c4d84d0df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.316039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3374cb65f1447b8a6305d3c4d84d0df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.324812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3374cb65f1447b8a6305d3c4d84d0df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:24.331912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1119/2244] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:24 2022] DELETE /identity/v3/users/a3374cb65f1447b8a6305d3c4d84d0df => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:24.332813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:24.334145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.372663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:24.374139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcdbd-090a-421f-8827-0694721f6476 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:24.384226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1126/2245] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:06:24.385756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.386076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.386355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.405125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef32371-2226-4192-92d6-ba048106b0a2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:24.406306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:24.407518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.409032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:24.409681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.409962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.410230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.412053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:24.475321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:24.486792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1127/2246] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:24.493499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:24.493709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:24.495310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:24.506223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e33542-550d-4517-ac54-983bc3d659c5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:24.507365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1120/2247] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:24.511005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:24.511661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:24.511970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:24.512243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:24.529022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:24.530556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:24.544483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1128/2248] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:24.989842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:24.993706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.011681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.013755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9f894-e864-41cf-8fb8-0ffac5164b34 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.013874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.019835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.020730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.021016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.021819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] PATH_INFO: `/v3/projects/394518477d1442919030fac1c06d925a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.022680 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394518477d1442919030fac1c06d925a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.024760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.033865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf3f7f-b8cf-44bd-bcc2-622ef00028cb service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.041068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.041872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.042093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.042629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] PATH_INFO: `/v3/projects/11e1ee2059a34c6d9ccab62ca68340cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.044928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e1ee2059a34c6d9ccab62ca68340cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.047042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.097968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394518477d1442919030fac1c06d925a', 'request_id': 'req-e4706457-a545-401b-939d-3b2c8d2e3b88'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.099779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e1ee2059a34c6d9ccab62ca68340cd', 'request_id': 'req-0bd8285e-748a-461b-99cc-d166e6d37386'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.103933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394518477d1442919030fac1c06d925a', 'request_id': 'req-e4706457-a545-401b-939d-3b2c8d2e3b88'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.106993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e1ee2059a34c6d9ccab62ca68340cd', 'request_id': 'req-0bd8285e-748a-461b-99cc-d166e6d37386'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.111309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394518477d1442919030fac1c06d925a', 'request_id': 'req-e4706457-a545-401b-939d-3b2c8d2e3b88'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.116145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e1ee2059a34c6d9ccab62ca68340cd', 'request_id': 'req-0bd8285e-748a-461b-99cc-d166e6d37386'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.129137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] The token cache is being invalidate because project 11e1ee2059a34c6d9ccab62ca68340cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:25.129431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.130146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] The token cache is being invalidate because project 394518477d1442919030fac1c06d925a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:25.130277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.130623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.131656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e4706457-a545-401b-939d-3b2c8d2e3b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.131912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1129/2249] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:25 2022] DELETE /identity/v3/projects/11e1ee2059a34c6d9ccab62ca68340cd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:25.134632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1121/2250] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:24 2022] DELETE /identity/v3/projects/394518477d1442919030fac1c06d925a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:25.135805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.137318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.139973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbe4e5-90e1-4e8f-858f-ec0bd2c470c9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.140358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbe4e5-90e1-4e8f-858f-ec0bd2c470c9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.140636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbe4e5-90e1-4e8f-858f-ec0bd2c470c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.148511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:25.159339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-46fbe4e5-90e1-4e8f-858f-ec0bd2c470c9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:25.160670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-46fbe4e5-90e1-4e8f-858f-ec0bd2c470c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.207868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8285e-748a-461b-99cc-d166e6d37386 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.212677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.213560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.213839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.214107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] PATH_INFO: `/v3/users/77b601668c454e12bfbdcbf10bf27821` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.215319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b601668c454e12bfbdcbf10bf27821)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.217340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.226703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1122/2251] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:25.239285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.239524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.239820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.262582 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:25.263825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.275011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1123/2252] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:25.276851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b601668c454e12bfbdcbf10bf27821'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.280215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.290621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba05dd8-93c3-46c8-9ac5-7f6abb024936 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.293523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b601668c454e12bfbdcbf10bf27821'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.295024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b601668c454e12bfbdcbf10bf27821'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.296483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.297182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.297468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.297748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.298487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:06:25.298799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.300509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.304896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b601668c454e12bfbdcbf10bf27821'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.314894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1124/2253] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:06:25.315170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b601668c454e12bfbdcbf10bf27821'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.319370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.321275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.323730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1130/2254] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:25 2022] DELETE /identity/v3/users/77b601668c454e12bfbdcbf10bf27821 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:25.334733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eeefd-4b75-4ad0-8021-4bd744fec31d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.388464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:25.401883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.402979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.403296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.403572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.404321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.406383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.443127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1125/2255] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:25.448321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.459777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ee576-6b8a-4a2e-872f-43868e8ebef0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.532697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.533434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.533723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.533993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.534736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.536750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.560502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1131/2256] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:25.564955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.577011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589186a-3f0c-4f62-b516-66b290d32505 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.582967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.584141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.584648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.585154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.586482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.588214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.604334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1126/2257] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:25.609053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.623852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5057bee-39b3-4101-a24d-def6f11a5eb6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.632158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.632971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.633844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.634195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.634476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.635303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.635575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.638323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.651795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1132/2258] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:25.656446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.657266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4376de-cb62-4ce9-b382-ced509b6d109 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.662347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.663246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.663530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.663833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] PATH_INFO: `/v3/projects/5c28a162618049a98f5b554bec4bba99` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.664307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:25.665437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c28a162618049a98f5b554bec4bba99)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.667552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.670993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d33bd-3b0d-4b0e-901c-13ec0b15a68b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.678678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7966d-8cbd-4179-afc8-edcb2e463bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.679812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7966d-8cbd-4179-afc8-edcb2e463bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.680284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7966d-8cbd-4179-afc8-edcb2e463bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.680716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7966d-8cbd-4179-afc8-edcb2e463bd4 admin admin] PATH_INFO: `/v3/projects/b4d4185f8b844b9cac7857f567fd8d56/users/540267e6657746228ca3c332ea182838/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.708425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7966d-8cbd-4179-afc8-edcb2e463bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d4185f8b844b9cac7857f567fd8d56, user_id=540267e6657746228ca3c332ea182838, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.711602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7966d-8cbd-4179-afc8-edcb2e463bd4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.732801 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1133/2259] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:25 2022] PUT /identity/v3/projects/b4d4185f8b844b9cac7857f567fd8d56/users/540267e6657746228ca3c332ea182838/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:25.737125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c28a162618049a98f5b554bec4bba99', 'request_id': 'req-7a21c79c-b426-4185-9ac2-e400542a3d73'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.744582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.745776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.745776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.748689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c28a162618049a98f5b554bec4bba99', 'request_id': 'req-7a21c79c-b426-4185-9ac2-e400542a3d73'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.757977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c28a162618049a98f5b554bec4bba99', 'request_id': 'req-7a21c79c-b426-4185-9ac2-e400542a3d73'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.773721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] The token cache is being invalidate because project 5c28a162618049a98f5b554bec4bba99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:25.774017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.774688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7a21c79c-b426-4185-9ac2-e400542a3d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:25.777425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1127/2260] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:25 2022] DELETE /identity/v3/projects/5c28a162618049a98f5b554bec4bba99 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:25.783401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09bc46-cb3b-4db8-998a-5dac64baebc9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.783698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09bc46-cb3b-4db8-998a-5dac64baebc9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.784116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09bc46-cb3b-4db8-998a-5dac64baebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.806545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-df09bc46-cb3b-4db8-998a-5dac64baebc9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:25.807826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-df09bc46-cb3b-4db8-998a-5dac64baebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.810172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] MFA Rules not processed for user `540267e6657746228ca3c332ea182838`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:25.811479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.874787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1128/2261] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:25.882613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.882987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.883279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.898803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1134/2262] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:25.903062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:25.904760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.910820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.912902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:25.915807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1129/2263] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:25.920616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.933597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeb3b6-1a5e-460e-90c7-a3f410b8e4cf None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.941063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.941767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.942118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.942332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.943073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:06:25.943382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.945625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:25.960401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1130/2264] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:06:25.975738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:25.990311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eedbf0-8eb0-4490-b082-7ca68c446f13 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.993795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86a563-37b5-41ed-bdaf-5fd3bcc3d87f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:25.995021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:25.995694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:25.996378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:25.996622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:25.997985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:25.999992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.001553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.002447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.002734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.003010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.013366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.014954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.026037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1135/2265] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:06:26.029053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1131/2266] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:26.033205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.045296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529949f-6baf-4c1f-ab89-52368486fcfb service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.143841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.144557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.145312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.145616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.146256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.148278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.178132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1136/2267] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:26 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:26.184277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.203324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76556a-a393-4f7f-97c9-f9a215e11692 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.210791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.212023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.212532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.213026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.214384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.217620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.220075 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:26.241138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1132/2268] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:26.246935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.258532 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:26.270539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771474-21e5-4aad-b3fe-894757431165 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.281123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef9ce9-24f8-4fbd-86b3-d20ee5685d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.282526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef9ce9-24f8-4fbd-86b3-d20ee5685d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.283099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef9ce9-24f8-4fbd-86b3-d20ee5685d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.283610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef9ce9-24f8-4fbd-86b3-d20ee5685d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.284769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef9ce9-24f8-4fbd-86b3-d20ee5685d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.287359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef9ce9-24f8-4fbd-86b3-d20ee5685d00 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.312686 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1137/2269] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:26.318226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.332984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2262b-d109-4122-a297-7126b334d19d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.339083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.340067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.340329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.340572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] PATH_INFO: `/v3/projects/efb30e0600f44c30916473cc5508450a/users/bb439ace99f047d3bf55c4ddfa6359e3/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.365432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb30e0600f44c30916473cc5508450a, user_id=bb439ace99f047d3bf55c4ddfa6359e3, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.368907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.384202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1133/2270] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:26 2022] PUT /identity/v3/projects/efb30e0600f44c30916473cc5508450a/users/bb439ace99f047d3bf55c4ddfa6359e3/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:26.395241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.395480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.395838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.429550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] MFA Rules not processed for user `bb439ace99f047d3bf55c4ddfa6359e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:26.431794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:26.506439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1138/2271] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:26.510896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.575730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01fcd-960f-4e18-922f-199bc44344b5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.580638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.581305 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.581591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.581868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.582576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.584714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.613079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1134/2272] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:26 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:26.617033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.628079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0459031-9324-4d9d-a11f-3abef192be44 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.690050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.690734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.691019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.691290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.692028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.694072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.717161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1139/2273] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:26 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:26.721375 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.732228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e69d-c14e-4d6d-8067-41f0083bab44 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.737205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.738057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.738383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.738660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.739405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.741086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.752742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1135/2274] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:26.757135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.768014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bba8a-53aa-4a29-ba13-e39d53edd0f5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.773087 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.774135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.774421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.774699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] PATH_INFO: `/v3/projects/61d00fd70e1e44b3acc9c42ac7854463/users/49e40a66b502454c9f617f086de85452/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.792016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d00fd70e1e44b3acc9c42ac7854463, user_id=49e40a66b502454c9f617f086de85452, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.794746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.809984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1140/2275] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:26 2022] PUT /identity/v3/projects/61d00fd70e1e44b3acc9c42ac7854463/users/49e40a66b502454c9f617f086de85452/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:26.814663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.825716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2366e-dec3-48c1-a2e1-08942b8dda65 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.885951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294234-2dab-4b42-b5b7-bafb70524ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.886637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294234-2dab-4b42-b5b7-bafb70524ead admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.886921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294234-2dab-4b42-b5b7-bafb70524ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.887197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294234-2dab-4b42-b5b7-bafb70524ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.888453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69294234-2dab-4b42-b5b7-bafb70524ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.890087 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69294234-2dab-4b42-b5b7-bafb70524ead admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.901094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1136/2276] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:26.906000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:26.917461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202405d5-f237-4bbe-8ae9-14097c81fd25 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:26.922341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:26.923246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.923528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.923822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] PATH_INFO: `/v3/projects/61d00fd70e1e44b3acc9c42ac7854463/users/49e40a66b502454c9f617f086de85452/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.925852 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d00fd70e1e44b3acc9c42ac7854463, user_id=49e40a66b502454c9f617f086de85452, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:26.928565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:26.945363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1141/2277] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:26 2022] PUT /identity/v3/projects/61d00fd70e1e44b3acc9c42ac7854463/users/49e40a66b502454c9f617f086de85452/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:26.958052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:26.958671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:26.958671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:26.989355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] MFA Rules not processed for user `49e40a66b502454c9f617f086de85452`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:26.990670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:27.025972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:27.046824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:27.049528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:27.077246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1137/2278] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:27.090104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:27.113912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:27.155801 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714323e-c81e-49fc-a800-769e8c669736 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:27.159458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a24c9-9d33-41ee-b9c6-1b215032a6ef None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:27.160731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:27.162919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:27.162919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:27.163260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] PATH_INFO: `/v3/users/f47ba07e8a3f4cb99626bd19a814cce1` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:27.164807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47ba07e8a3f4cb99626bd19a814cce1)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:27.165429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6e3a7-2bd6-4c60-a9c0-c760100143dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:27.166189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6e3a7-2bd6-4c60-a9c0-c760100143dd service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:27.166491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6e3a7-2bd6-4c60-a9c0-c760100143dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:27.166796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6e3a7-2bd6-4c60-a9c0-c760100143dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:27.167884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:27.241883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6e3a7-2bd6-4c60-a9c0-c760100143dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:27.243360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6e3a7-2bd6-4c60-a9c0-c760100143dd service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:27.246660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47ba07e8a3f4cb99626bd19a814cce1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:27.261221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1138/2279] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:27.265945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47ba07e8a3f4cb99626bd19a814cce1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:27.276538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47ba07e8a3f4cb99626bd19a814cce1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:27.288605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47ba07e8a3f4cb99626bd19a814cce1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:27.301192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47ba07e8a3f4cb99626bd19a814cce1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:27.309894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1142/2280] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:27 2022] DELETE /identity/v3/users/f47ba07e8a3f4cb99626bd19a814cce1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:27.314254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:27.314589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:27.314813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:27.334046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:27.335278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:27.437096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1139/2281] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:27.447476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:27.449321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:27.558799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152ff89-fd3d-433c-91b2-7a4550cdc18b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:27.569433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:27.570518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:27.571036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:27.571546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:27.600592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:27.603483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:27.626398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1143/2282] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:28.017504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:28.019656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:28.035251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f5777-fbe4-4fc6-ad57-d038c30b830f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:28.042753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:28.043853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:28.044129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:28.044423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] PATH_INFO: `/v3/projects/67b22ff9e9374d9fab01292e0f40a714` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:28.045761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b22ff9e9374d9fab01292e0f40a714)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:28.047729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:28.066800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:28.100542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b22ff9e9374d9fab01292e0f40a714', 'request_id': 'req-36ab7196-1b8e-4fe9-b459-3fdab62136bb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.106682 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b22ff9e9374d9fab01292e0f40a714', 'request_id': 'req-36ab7196-1b8e-4fe9-b459-3fdab62136bb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.113351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b22ff9e9374d9fab01292e0f40a714', 'request_id': 'req-36ab7196-1b8e-4fe9-b459-3fdab62136bb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.126339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] The token cache is being invalidate because project 67b22ff9e9374d9fab01292e0f40a714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:28.126623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.127244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.130712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1140/2283] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:28 2022] DELETE /identity/v3/projects/67b22ff9e9374d9fab01292e0f40a714 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:28.133586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:28.145175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae5678-5416-4556-8230-8c14495c76f7 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:28.202086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:28.210986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:28.212349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:28.212893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:28.213427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] PATH_INFO: `/v3/users/4486c3e1112e42259474f9130e9a42d4` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:28.214918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4486c3e1112e42259474f9130e9a42d4)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:28.217138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:28.269093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4486c3e1112e42259474f9130e9a42d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.281131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4486c3e1112e42259474f9130e9a42d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.281833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4486c3e1112e42259474f9130e9a42d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.288676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4486c3e1112e42259474f9130e9a42d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.296782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4486c3e1112e42259474f9130e9a42d4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.302939 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1144/2284] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:28 2022] DELETE /identity/v3/users/4486c3e1112e42259474f9130e9a42d4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:28.591871 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:28.593544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:28.607318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7196-1b8e-4fe9-b459-3fdab62136bb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:28.666642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:28.667514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:28.667818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:28.668095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] PATH_INFO: `/v3/projects/a08bb8b881764a0c8212e4db5fd24b21` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:28.669924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08bb8b881764a0c8212e4db5fd24b21)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:28.672028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:28.724806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08bb8b881764a0c8212e4db5fd24b21', 'request_id': 'req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.732063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08bb8b881764a0c8212e4db5fd24b21', 'request_id': 'req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.742090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08bb8b881764a0c8212e4db5fd24b21', 'request_id': 'req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.758845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] The token cache is being invalidate because project a08bb8b881764a0c8212e4db5fd24b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:28.759066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.759720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:28.775789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1141/2285] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:28 2022] DELETE /identity/v3/projects/a08bb8b881764a0c8212e4db5fd24b21 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:34.094346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:34.095825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:34.152563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef24f-fb8a-4c67-b379-79c7ba8eba22 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:34.200656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:34.201302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:34.201579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:34.201854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:34.203622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:34.248761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:34.268910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:34.270406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e3aae-66c3-4857-9f50-b4ce7609263e service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:34.280099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1145/2286] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:38.755500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:42.694968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:42.696558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:42.805394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec4aa-7714-4440-bbc1-d4604d3ef1f5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:42.810623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:42.811490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:42.811788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:42.812071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] PATH_INFO: `/v3/users/540267e6657746228ca3c332ea182838` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:42.813264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540267e6657746228ca3c332ea182838)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:42.815216 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:42.860626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540267e6657746228ca3c332ea182838'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:42.872611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540267e6657746228ca3c332ea182838'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:42.879499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540267e6657746228ca3c332ea182838'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:42.880314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540267e6657746228ca3c332ea182838'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:42.888330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540267e6657746228ca3c332ea182838'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:42.894218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1142/2287] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:06:42 2022] DELETE /identity/v3/users/540267e6657746228ca3c332ea182838 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:42.898789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:42.899272 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:42.899368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:42.916911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:42.918115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:42.976763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1146/2288] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:06:42.986293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:42.987685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:43.029276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:43.086370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d5dc6-92c7-4871-9877-813079256dc5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.090267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7392-6a1c-4244-be83-434e664089fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.090928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7392-6a1c-4244-be83-434e664089fd service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.091241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7392-6a1c-4244-be83-434e664089fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.091519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7392-6a1c-4244-be83-434e664089fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.101104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7392-6a1c-4244-be83-434e664089fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.102557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7392-6a1c-4244-be83-434e664089fd service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.112137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1143/2289] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:43.390638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.392145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:43.404027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921af84-2d86-4548-95cc-8e183b8e1f82 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.408925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.410029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.410384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.410608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] PATH_INFO: `/v3/projects/b4d4185f8b844b9cac7857f567fd8d56` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.411992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d4185f8b844b9cac7857f567fd8d56)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.413842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.462336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d4185f8b844b9cac7857f567fd8d56', 'request_id': 'req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:43.467863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d4185f8b844b9cac7857f567fd8d56', 'request_id': 'req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:43.475195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d4185f8b844b9cac7857f567fd8d56', 'request_id': 'req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:43.486716 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] The token cache is being invalidate because project b4d4185f8b844b9cac7857f567fd8d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:06:43.486943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:43.487600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-57e0f673-40ff-42e4-a0f7-56c2cd3e0bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:06:43.489173 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1147/2290] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:06:43 2022] DELETE /identity/v3/projects/b4d4185f8b844b9cac7857f567fd8d56 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:06:43.494578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.494870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.495144 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.514085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:43.515270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:43.574033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1144/2291] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:43.581998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.582286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.582565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.601553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:43.602736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:43.611444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1148/2292] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:43.615585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.625512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ffa1b-220d-4aab-bf68-a974f8a65346 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.629986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.630629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.630908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.631180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.631941 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:06:43.632268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.633853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.645533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1145/2293] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:06:43.649839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.660814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d493d-dca6-4f1a-8348-3829aa710d6b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.666241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.667185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.667516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.667941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.669369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.671432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.697888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1149/2294] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:06:43 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:06:43.701993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.711968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbdb43-e8b9-4690-99c4-a9bada2f4870 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.769600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.770182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.770461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.770734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.771421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.773392 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.796952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1146/2295] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:06:43 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:06:43.801992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.812697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d22c56-c24f-4b4c-a87c-4ce90fcde055 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.817451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.818117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.818401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.818677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.819405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.821041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.831431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1150/2296] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:43.835426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.846166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54048b8-563f-4811-af88-10ea801256ac admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.850806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267ed51-1e0f-4dce-9b56-f03c00bc4a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.851460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ed51-1e0f-4dce-9b56-f03c00bc4a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.851748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ed51-1e0f-4dce-9b56-f03c00bc4a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.852061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ed51-1e0f-4dce-9b56-f03c00bc4a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.852784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267ed51-1e0f-4dce-9b56-f03c00bc4a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.854400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267ed51-1e0f-4dce-9b56-f03c00bc4a1e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.865037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1147/2297] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:06:43.869148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:43.879076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3e8e-4154-4042-a248-30557e7bdacf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:43.883679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:43.884584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.884862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.885137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] PATH_INFO: `/v3/projects/485c2aa1c9b444f0ae21b96e4bdf9c56/users/fc5424ed750348f6b46045b2a4e86762/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.900061 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485c2aa1c9b444f0ae21b96e4bdf9c56, user_id=fc5424ed750348f6b46045b2a4e86762, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:43.903393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:43.912758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:43.918795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1151/2298] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:06:43 2022] PUT /identity/v3/projects/485c2aa1c9b444f0ae21b96e4bdf9c56/users/fc5424ed750348f6b46045b2a4e86762/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:06:43.929886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:43.930215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:43.930498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:43.948668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:43.959090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] MFA Rules not processed for user `fc5424ed750348f6b46045b2a4e86762`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:06:43.960335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:44.025308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1148/2299] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:06:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:06:44.037179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:06:44.038878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:06:44.095328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d951ad-f810-4d7d-a963-074448aefe59 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:06:44.099072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5d6a1-1eb7-4adf-8869-417eb21a9da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:06:44.099717 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5d6a1-1eb7-4adf-8869-417eb21a9da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:06:44.100030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5d6a1-1eb7-4adf-8869-417eb21a9da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:06:44.100312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5d6a1-1eb7-4adf-8869-417eb21a9da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:06:44.108713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5d6a1-1eb7-4adf-8869-417eb21a9da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:06:44.110163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5d6a1-1eb7-4adf-8869-417eb21a9da1 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:06:44.118871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1152/2300] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:06:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:06:54.022248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=28 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:06:54.114902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=26 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:01.485856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:01.569899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3a0c9-a366-4bdd-8a62-a0de8801c483 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:01.574470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:01.576089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:01.576356 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:01.576631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] PATH_INFO: `/v3/users/fc5424ed750348f6b46045b2a4e86762` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:01.577831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5424ed750348f6b46045b2a4e86762)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:01.579802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:01.626018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5424ed750348f6b46045b2a4e86762'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:01.638708 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5424ed750348f6b46045b2a4e86762'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:01.645540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5424ed750348f6b46045b2a4e86762'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:01.646211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5424ed750348f6b46045b2a4e86762'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:01.653524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5424ed750348f6b46045b2a4e86762'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:01.659450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1149/2301] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:07:01 2022] DELETE /identity/v3/users/fc5424ed750348f6b46045b2a4e86762 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:01.664119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:01.664863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:01.664965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:01.691167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:01.692412 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:01.751148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1153/2302] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:01.761467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:01.763488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:01.827380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab597-1073-49d2-93c6-59c66f5adfeb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:01.831921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:01.832621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:01.832866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:01.833137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:01.843911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:01.845377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:01.855451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1150/2303] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:07:02.398664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:02.400185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:02.415784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa0679-d19b-4144-ac06-2b89c34ae401 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:02.422120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:02.422998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:02.423277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:02.423549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] PATH_INFO: `/v3/projects/485c2aa1c9b444f0ae21b96e4bdf9c56` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:02.424958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485c2aa1c9b444f0ae21b96e4bdf9c56)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:02.426868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:02.474800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485c2aa1c9b444f0ae21b96e4bdf9c56', 'request_id': 'req-e7a840af-080a-4205-8eca-818c2a976b43'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:02.480396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485c2aa1c9b444f0ae21b96e4bdf9c56', 'request_id': 'req-e7a840af-080a-4205-8eca-818c2a976b43'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:02.489589 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485c2aa1c9b444f0ae21b96e4bdf9c56', 'request_id': 'req-e7a840af-080a-4205-8eca-818c2a976b43'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:02.504308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] The token cache is being invalidate because project 485c2aa1c9b444f0ae21b96e4bdf9c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:07:02.504602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:02.505240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e7a840af-080a-4205-8eca-818c2a976b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:02.506805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1154/2304] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:07:02 2022] DELETE /identity/v3/projects/485c2aa1c9b444f0ae21b96e4bdf9c56 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:10.378339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:10.379819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:10.388837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:10.392589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19266f77-3257-45bd-9015-8cc8927496d7 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:10.451024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:10.451946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:10.452234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:10.452512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] PATH_INFO: `/v3/users/bb439ace99f047d3bf55c4ddfa6359e3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:10.453705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb439ace99f047d3bf55c4ddfa6359e3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:10.455651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:10.502191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb439ace99f047d3bf55c4ddfa6359e3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:10.514074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb439ace99f047d3bf55c4ddfa6359e3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:10.520898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb439ace99f047d3bf55c4ddfa6359e3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:10.521559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb439ace99f047d3bf55c4ddfa6359e3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:10.530040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb439ace99f047d3bf55c4ddfa6359e3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:10.536167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1151/2305] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:07:10 2022] DELETE /identity/v3/users/bb439ace99f047d3bf55c4ddfa6359e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:10.541177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:10.541663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:10.541758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:10.559951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:10.561418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:10.620067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1155/2306] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:10.629362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:10.630770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:10.689399 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a347b-4935-42d9-9ae5-081c55e6081d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:10.693057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:10.693700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:10.693978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:10.694249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:10.703304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:10.704778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:10.714134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1152/2307] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:07:10.978963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:10.980420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:10.992781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72bc83-9157-4133-ab59-9b321a6d3d1a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:10.997720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:10.998668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:10.999024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:10.999378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] PATH_INFO: `/v3/projects/efb30e0600f44c30916473cc5508450a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.001604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb30e0600f44c30916473cc5508450a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:11.004026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:11.016662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:11.054325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb30e0600f44c30916473cc5508450a', 'request_id': 'req-a0893f65-2d24-453f-bb04-284b2f3fb5a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.059682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb30e0600f44c30916473cc5508450a', 'request_id': 'req-a0893f65-2d24-453f-bb04-284b2f3fb5a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.067040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb30e0600f44c30916473cc5508450a', 'request_id': 'req-a0893f65-2d24-453f-bb04-284b2f3fb5a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.078906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] The token cache is being invalidate because project efb30e0600f44c30916473cc5508450a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:07:11.079198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.079880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.081420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1156/2308] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:07:10 2022] DELETE /identity/v3/projects/efb30e0600f44c30916473cc5508450a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:11.085425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:11.095652 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddc00c-e01d-4618-bd0d-76f8b1d47387 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:11.119278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:11.154050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:11.154976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:11.155276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:11.155530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] PATH_INFO: `/v3/users/49e40a66b502454c9f617f086de85452` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.156973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e40a66b502454c9f617f086de85452)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:11.158974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:11.207033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e40a66b502454c9f617f086de85452'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.219229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e40a66b502454c9f617f086de85452'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.226577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e40a66b502454c9f617f086de85452'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.227270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e40a66b502454c9f617f086de85452'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.234439 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-13e2af32-df37-464a-9d85-e7d78c03b7e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e40a66b502454c9f617f086de85452'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.241354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1153/2309] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:07:11 2022] DELETE /identity/v3/users/49e40a66b502454c9f617f086de85452 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:07:11.591901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:11.593370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:11.608988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0893f65-2d24-453f-bb04-284b2f3fb5a6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:11.666381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:11.667255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:11.667537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:11.667843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] PATH_INFO: `/v3/projects/61d00fd70e1e44b3acc9c42ac7854463` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.669508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d00fd70e1e44b3acc9c42ac7854463)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:11.671434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:11.717099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d00fd70e1e44b3acc9c42ac7854463', 'request_id': 'req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.722580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d00fd70e1e44b3acc9c42ac7854463', 'request_id': 'req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.729970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d00fd70e1e44b3acc9c42ac7854463', 'request_id': 'req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.743965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] The token cache is being invalidate because project 61d00fd70e1e44b3acc9c42ac7854463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:07:11.744258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.744900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a3e2566d-71eb-4b9c-90ce-4e059c2d7b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:11.746442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1157/2310] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:07:11 2022] DELETE /identity/v3/projects/61d00fd70e1e44b3acc9c42ac7854463 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:11.753150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:11.753629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:11.753720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.811464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:11.812693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:11.872815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1154/2311] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:11.880587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:11.880876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:11.881154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.899194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:11.900418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:11.908397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1158/2312] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:11.912514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:11.923001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8dd92-8a49-4b3d-9cb4-f50664634390 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:11.927628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:11.928307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:11.928643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:11.928922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.929654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:07:11.929959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:11.931595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:11.946917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1155/2313] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:07:11.951595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:11.961420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab04b1-5ba2-432d-a692-ca0f3d451b1f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:11.966897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:11.967561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:11.967947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:11.968228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:11.968927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:11.970860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:12.001362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1159/2314] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:07:11 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:07:12.004608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:12.015099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540de52-d461-4464-9e1e-df8d2ba8edb5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:12.020540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:12.075084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:12.075759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:12.076065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:12.076339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:12.077019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:12.078964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:12.101425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1156/2315] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:07:12 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:07:12.105479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:12.112957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:12.119670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5469ec-9bc1-4857-82e3-47e6486a8273 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:12.125637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:12.126246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:12.126561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:12.126850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:12.127575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:12.129295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:12.140470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1160/2316] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:07:12.144464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:12.154916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a198bc-5034-4825-b6ff-29022a1345a6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:12.159572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922f230-b18e-40b4-9e9d-cc705f9d7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:12.160343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f230-b18e-40b4-9e9d-cc705f9d7cde admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:12.160536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f230-b18e-40b4-9e9d-cc705f9d7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:12.160808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922f230-b18e-40b4-9e9d-cc705f9d7cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:12.161525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922f230-b18e-40b4-9e9d-cc705f9d7cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:12.163123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922f230-b18e-40b4-9e9d-cc705f9d7cde admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:12.178219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1157/2317] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:07:12.182473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:12.193124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043fbb2-ac47-4b9a-903a-d473cd769a8b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:12.197719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:12.198597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:12.198879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:12.199155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] PATH_INFO: `/v3/projects/af36c7fddd404ff5979af0dd54e7f887/users/07e9341f0f7942ff90becc7ff4e9682a/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:12.213447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af36c7fddd404ff5979af0dd54e7f887, user_id=07e9341f0f7942ff90becc7ff4e9682a, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:12.216915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:12.230183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1161/2318] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:07:12 2022] PUT /identity/v3/projects/af36c7fddd404ff5979af0dd54e7f887/users/07e9341f0f7942ff90becc7ff4e9682a/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:12.241966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:12.242256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:12.242534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:12.271966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] MFA Rules not processed for user `07e9341f0f7942ff90becc7ff4e9682a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:12.273186 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:12.337010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1158/2319] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:12.348277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:12.349975 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:12.408934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ae26-32fb-4539-9dcb-df89af6a20d2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:12.412747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa03b2c-69be-4c62-889c-8d7236c22a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:12.413395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa03b2c-69be-4c62-889c-8d7236c22a94 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:12.413678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa03b2c-69be-4c62-889c-8d7236c22a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:12.413955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa03b2c-69be-4c62-889c-8d7236c22a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:12.422624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa03b2c-69be-4c62-889c-8d7236c22a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:12.424115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa03b2c-69be-4c62-889c-8d7236c22a94 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:12.433005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1162/2320] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:07:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:07:15.417775 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:15.480366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56a71-c104-4974-a4ad-13abbbca25e1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:15.485440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:15.486315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:15.486592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:15.486867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] PATH_INFO: `/v3/users/07e9341f0f7942ff90becc7ff4e9682a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:15.488564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e9341f0f7942ff90becc7ff4e9682a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:15.490697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:15.517036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:15.544788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e9341f0f7942ff90becc7ff4e9682a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:15.557061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e9341f0f7942ff90becc7ff4e9682a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:15.563918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e9341f0f7942ff90becc7ff4e9682a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:15.564600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e9341f0f7942ff90becc7ff4e9682a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:15.572219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e9341f0f7942ff90becc7ff4e9682a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:15.578655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1159/2321] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:07:15 2022] DELETE /identity/v3/users/07e9341f0f7942ff90becc7ff4e9682a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:15.583163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:15.583629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:15.583721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:15.601180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:15.602364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:15.660918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1163/2322] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:15.670713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:15.672123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:15.728968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ca8c1-43ca-4d26-b1d7-3dc16b9dadfb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:15.733113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27f4f-63c4-4dc5-8391-a1a528bc656c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:15.733759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27f4f-63c4-4dc5-8391-a1a528bc656c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:15.734038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27f4f-63c4-4dc5-8391-a1a528bc656c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:15.734310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27f4f-63c4-4dc5-8391-a1a528bc656c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:15.744472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27f4f-63c4-4dc5-8391-a1a528bc656c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:15.745921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27f4f-63c4-4dc5-8391-a1a528bc656c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:15.755815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1160/2323] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:07:16.036015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.037588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:16.053537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26d8d-fa8c-4b35-a9e9-a4d728ec7a27 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.065888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.066768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.067052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.067331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] PATH_INFO: `/v3/projects/af36c7fddd404ff5979af0dd54e7f887` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.068669 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af36c7fddd404ff5979af0dd54e7f887)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.070614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.122165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af36c7fddd404ff5979af0dd54e7f887', 'request_id': 'req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:16.128920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af36c7fddd404ff5979af0dd54e7f887', 'request_id': 'req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:16.136338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af36c7fddd404ff5979af0dd54e7f887', 'request_id': 'req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:16.137531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:16.150553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] The token cache is being invalidate because project af36c7fddd404ff5979af0dd54e7f887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:07:16.150846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:16.151516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-dd27f3f2-111e-4c54-80d8-8cbed2650fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:07:16.153111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1164/2324] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:07:16 2022] DELETE /identity/v3/projects/af36c7fddd404ff5979af0dd54e7f887 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:16.158132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.158433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.158714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.177084 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:16.178217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:16.254464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1161/2325] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:16.262422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.262718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.263552 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.284305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:16.285524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:16.294315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1165/2326] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:16.298762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.309029 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c569bd-a6c2-418b-a0aa-eebdaa1dc518 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.313723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.314401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.314683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.314961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.315697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:07:16.316062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.317689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.330365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1162/2327] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:07:16.334743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.345008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dc96d-bb2b-4d5b-8722-13f83e538ba3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.349730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.350484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.350679 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.350956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.351658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.353630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.384048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1166/2328] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:07:16 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:07:16.385339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.395995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d6c88-62ac-4d1b-bce3-907f465f4873 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.421729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:16.457308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.457910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.458196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.458472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.459244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.461166 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.481266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1163/2329] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:07:16 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:07:16.485571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.495835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c918a-4857-46b9-afb8-31ea4c0dd535 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.501226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.501881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.502163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.502439 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.503155 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.504782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.515677 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1167/2330] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:07:16.519540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.529542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac07d-bd78-43d1-a511-3b00d4a456d3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.534299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf11e90-6d8c-4372-b515-cf8169624fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.535041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11e90-6d8c-4372-b515-cf8169624fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.535339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11e90-6d8c-4372-b515-cf8169624fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.535616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11e90-6d8c-4372-b515-cf8169624fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.536368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf11e90-6d8c-4372-b515-cf8169624fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.537964 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf11e90-6d8c-4372-b515-cf8169624fe3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.548477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1164/2331] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:07:16.552485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.563109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bcb98-9698-4d98-a1dd-2b3346845165 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.567838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.568721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.569003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.569276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] PATH_INFO: `/v3/projects/125a8992ef0c4f838222c21d33bf7917/users/9d76291c0c0d4ed68c56275e314e4a61/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.584551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125a8992ef0c4f838222c21d33bf7917, user_id=9d76291c0c0d4ed68c56275e314e4a61, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.587363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.601797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1168/2332] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:07:16 2022] PUT /identity/v3/projects/125a8992ef0c4f838222c21d33bf7917/users/9d76291c0c0d4ed68c56275e314e4a61/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:07:16.612559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.612854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.613135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.639837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] MFA Rules not processed for user `9d76291c0c0d4ed68c56275e314e4a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:16.641076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:16.713457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1165/2333] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:16.725035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:16.726769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:16.785727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8a5f-2fa9-47ca-ae41-b5b67a0e2e96 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:16.789807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9bec9-d3f5-46e3-8b2c-7e8ad525f317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:16.790457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9bec9-d3f5-46e3-8b2c-7e8ad525f317 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:16.790742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9bec9-d3f5-46e3-8b2c-7e8ad525f317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:16.791019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9bec9-d3f5-46e3-8b2c-7e8ad525f317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:16.805355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9bec9-d3f5-46e3-8b2c-7e8ad525f317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:16.806832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9bec9-d3f5-46e3-8b2c-7e8ad525f317 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:16.816083 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1169/2334] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:07:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:07:26.710152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:26.811845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:35.841984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:07:35.843449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:35.968378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27d03e-6a56-4e15-993d-ca40d8a56530 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:07:35.973454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:07:35.974282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:35.974565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:35.974833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:35.976605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:35.992982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:07:35.995030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:07:36.006245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1166/2335] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:07:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:07:43.288362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b125b-6931-467c-8532-4bc16ef2117f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:07:43.289306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b125b-6931-467c-8532-4bc16ef2117f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:07:43.289306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b125b-6931-467c-8532-4bc16ef2117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:07:43.306906 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-353b125b-6931-467c-8532-4bc16ef2117f None None] MFA Rules not processed for user `3d8fbafbd63c4e1c946b414e2842eb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:07:43.308131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-353b125b-6931-467c-8532-4bc16ef2117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:07:43.367934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1170/2336] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:07:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:07:46.001533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=41 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:07:53.358962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=25 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:00.136729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:00.199965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3960ad-18fb-4104-8e23-742017a938ef service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:00.204960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:00.205833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.206145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.206480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] PATH_INFO: `/v3/users/9d76291c0c0d4ed68c56275e314e4a61` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.207904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d76291c0c0d4ed68c56275e314e4a61)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:00.209613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:00.258813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d76291c0c0d4ed68c56275e314e4a61'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.273548 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d76291c0c0d4ed68c56275e314e4a61'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.280931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d76291c0c0d4ed68c56275e314e4a61'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.281715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d76291c0c0d4ed68c56275e314e4a61'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.290157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d76291c0c0d4ed68c56275e314e4a61'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.296589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1167/2337] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:08:00 2022] DELETE /identity/v3/users/9d76291c0c0d4ed68c56275e314e4a61 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:08:00.301179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.301665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.301766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.320121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:00.321328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:00.382976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1171/2338] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:00.393217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:00.394690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:00.453583 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534cb5a-1b0e-4108-87b9-cdc1f1ffc22d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:00.457265 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a63d1-ec00-4a74-91d0-7541367d5049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:00.457915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a63d1-ec00-4a74-91d0-7541367d5049 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.458195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a63d1-ec00-4a74-91d0-7541367d5049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.458469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a63d1-ec00-4a74-91d0-7541367d5049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.467633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a63d1-ec00-4a74-91d0-7541367d5049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:00.469116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a63d1-ec00-4a74-91d0-7541367d5049 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:00.478632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1168/2339] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:08:00.747497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:00.749080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:00.761146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc4963-72e5-476f-b0fc-ad56f0235d2a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:00.766979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:00.768147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.768478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.768884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] PATH_INFO: `/v3/projects/125a8992ef0c4f838222c21d33bf7917` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.770152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125a8992ef0c4f838222c21d33bf7917)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:00.772375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:00.821432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125a8992ef0c4f838222c21d33bf7917', 'request_id': 'req-28241443-8a42-495e-ad43-e283f6a338e2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.826892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125a8992ef0c4f838222c21d33bf7917', 'request_id': 'req-28241443-8a42-495e-ad43-e283f6a338e2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.834751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125a8992ef0c4f838222c21d33bf7917', 'request_id': 'req-28241443-8a42-495e-ad43-e283f6a338e2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.846700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] The token cache is being invalidate because project 125a8992ef0c4f838222c21d33bf7917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:08:00.846989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.847807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-28241443-8a42-495e-ad43-e283f6a338e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:08:00.849444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1172/2340] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:08:00 2022] DELETE /identity/v3/projects/125a8992ef0c4f838222c21d33bf7917 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:08:00.854261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.854550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.854828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.873129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:00.874440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:00.891731 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:00.935530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1169/2341] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:00.943587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.943926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.944242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.963295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:00.964554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:00.973197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1173/2342] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:00.977423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:00.987353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27879-bad0-474e-8e86-8fbe7ac6e218 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:00.992070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:00.992755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:00.993040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:00.993314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:00.994043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:08:00.994353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:00.996005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.008377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1170/2343] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:08:01.012633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:01.024135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20197-b115-490d-b6f1-91d31942d823 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:01.031342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:01.032121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.032409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.032693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.033397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:01.035419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.066337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1174/2344] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:08:01 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:08:01.074937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:01.085713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ceb17-9123-4e8d-92b0-fcb06a3e7e01 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:01.145019 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:01.145675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.145889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.146168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.146856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:01.148855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.171786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1171/2345] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:08:01 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:08:01.174106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:01.184533 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a905-8ebb-428f-af38-4589a0eb8fbd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:01.190035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:01.190831 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.191151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.191496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.192337 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:01.194045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.205361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1175/2346] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:08:01.209528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:01.220020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802154-b3d6-403a-8841-fab639712fee admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:01.224774 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4409-4eb8-4f02-b974-12744fc748af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:01.225430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4409-4eb8-4f02-b974-12744fc748af admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.225713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4409-4eb8-4f02-b974-12744fc748af admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.226017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4409-4eb8-4f02-b974-12744fc748af admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.226745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4409-4eb8-4f02-b974-12744fc748af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:01.228415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4409-4eb8-4f02-b974-12744fc748af admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.238918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1172/2347] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:08:01.242835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:01.253400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48165f3-adf2-4789-b67a-da8a264b8a1c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:01.258052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:01.258932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.259232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.259501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] PATH_INFO: `/v3/projects/c506ed29f8d94060bb8685604e8f3798/users/acbec87f607d4e00a2107c572fc68643/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.274933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c506ed29f8d94060bb8685604e8f3798, user_id=acbec87f607d4e00a2107c572fc68643, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:01.277790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.291398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1176/2348] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:08:01 2022] PUT /identity/v3/projects/c506ed29f8d94060bb8685604e8f3798/users/acbec87f607d4e00a2107c572fc68643/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:08:01.296610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8cf7f-bfba-4ca2-ade6-7983c1bcee1c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.296922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8cf7f-bfba-4ca2-ade6-7983c1bcee1c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.297217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8cf7f-bfba-4ca2-ade6-7983c1bcee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.315401 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2ef8cf7f-bfba-4ca2-ade6-7983c1bcee1c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:01.316647 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2ef8cf7f-bfba-4ca2-ade6-7983c1bcee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:01.374906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1173/2349] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:01.384868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:01.386559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:01.408571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:01.445622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767e0a4-3f32-48c0-83a3-b2b6f4264dc7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:01.449260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:01.449932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:01.450213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:01.450488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:01.459916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:01.461399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:01.470795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1177/2350] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:08:05.610106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:05.610639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:05.610639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:05.639839 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] MFA Rules not processed for user `acbec87f607d4e00a2107c572fc68643`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:05.642001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:05.659930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:05.711522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1174/2351] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:05.716015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:05.726020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64475-4f88-4637-9099-d60cd209438c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:05.731779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:05.732642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:05.733046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:05.733514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:05.734418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:05.736526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:05.766401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1178/2352] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:08:05 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:08:05.767695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:05.778628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46d23b-bae5-4772-9a10-6acaa72204ca None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:05.842724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:05.843410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:05.843877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:05.844242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:05.844946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:05.847063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:05.868292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1175/2353] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:08:05 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:08:05.872188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:05.883030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e564e0-41f7-47f8-9f19-28fc50d7f763 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:05.887604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:05.888291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:05.888576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:05.888896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:05.889568 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:05.891182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:05.902583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1179/2354] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:08:05.906768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:05.917156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34226ec-55a4-4578-b858-578821ee3fd3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:05.921763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:05.923171 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:05.923452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:05.923724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] PATH_INFO: `/v3/projects/607ecdc5628b4922b7717aca2123f06c/users/e5bdac0624594b14b40c8126bad72236/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:05.939055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=607ecdc5628b4922b7717aca2123f06c, user_id=e5bdac0624594b14b40c8126bad72236, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:05.941887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:05.954828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1176/2355] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:08:05 2022] PUT /identity/v3/projects/607ecdc5628b4922b7717aca2123f06c/users/e5bdac0624594b14b40c8126bad72236/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:08:05.958816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:05.969407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3432b8-cf69-4182-9163-9e1d3b5f04f9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:06.030237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32786b9d-52ac-4d08-be64-a8f88e485bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:06.031014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32786b9d-52ac-4d08-be64-a8f88e485bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:06.031301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32786b9d-52ac-4d08-be64-a8f88e485bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:06.031577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32786b9d-52ac-4d08-be64-a8f88e485bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:06.033022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32786b9d-52ac-4d08-be64-a8f88e485bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:06.034872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32786b9d-52ac-4d08-be64-a8f88e485bd3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:06.048005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1180/2356] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:08:06.052132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:06.063506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0c80-e9c5-472a-8bbc-053db7f0d28f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:06.070885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:06.071841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:06.072130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:06.072411 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] PATH_INFO: `/v3/projects/607ecdc5628b4922b7717aca2123f06c/users/e5bdac0624594b14b40c8126bad72236/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:06.074450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=607ecdc5628b4922b7717aca2123f06c, user_id=e5bdac0624594b14b40c8126bad72236, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:06.077198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:06.092275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1177/2357] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:08:06 2022] PUT /identity/v3/projects/607ecdc5628b4922b7717aca2123f06c/users/e5bdac0624594b14b40c8126bad72236/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:08:11.174594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b0bd-b977-4dc3-acef-b9cee5c30820 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:11.175132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b0bd-b977-4dc3-acef-b9cee5c30820 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:11.175263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b0bd-b977-4dc3-acef-b9cee5c30820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:11.210212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7b68b0bd-b977-4dc3-acef-b9cee5c30820 None None] MFA Rules not processed for user `e5bdac0624594b14b40c8126bad72236`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:11.211876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7b68b0bd-b977-4dc3-acef-b9cee5c30820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:11.325262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1181/2358] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:11.339721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:11.341574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:11.425943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:11.463168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd250b-cec9-4e6c-af8b-2ca043e52841 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:11.469355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:11.470202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:11.470581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:11.470970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:11.540435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:11.542102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:11.553956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1178/2359] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:08:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:08:21.319866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:21.549319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=36 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:27.156883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c041e-a59d-42f8-861d-7c1f386baff0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:27.157461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c041e-a59d-42f8-861d-7c1f386baff0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:27.157705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c041e-a59d-42f8-861d-7c1f386baff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:27.228865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e36c041e-a59d-42f8-861d-7c1f386baff0 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:27.230180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e36c041e-a59d-42f8-861d-7c1f386baff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:27.308509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1182/2360] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:08:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:27.367249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:27.369476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:27.469620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3c7d-16d4-4f0a-bd7b-2d2caf773ce0 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:27.476137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1018d-4f2c-4861-8e7d-6c655efc3c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:27.476801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1018d-4f2c-4861-8e7d-6c655efc3c92 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:27.477083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1018d-4f2c-4861-8e7d-6c655efc3c92 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:27.477355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1018d-4f2c-4861-8e7d-6c655efc3c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:27.487783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1018d-4f2c-4861-8e7d-6c655efc3c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:27.490670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1018d-4f2c-4861-8e7d-6c655efc3c92 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:27.502917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1179/2361] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:08:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:08:37.305334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=44 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:37.501246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=41 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:08:37.568928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13a9f6-36d0-46ed-b6e7-f1bb7f3707c9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:37.569213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13a9f6-36d0-46ed-b6e7-f1bb7f3707c9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:37.569477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13a9f6-36d0-46ed-b6e7-f1bb7f3707c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:37.590586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dc13a9f6-36d0-46ed-b6e7-f1bb7f3707c9 None None] MFA Rules not processed for user `acbec87f607d4e00a2107c572fc68643`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:37.592118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dc13a9f6-36d0-46ed-b6e7-f1bb7f3707c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:37.601837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1183/2362] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:08:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:47.557692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1e975-6fcf-4895-9e75-42f89031f526 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:47.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1e975-6fcf-4895-9e75-42f89031f526 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:47.558307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1e975-6fcf-4895-9e75-42f89031f526 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:47.559530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1180/2363] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:08:47.565547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db746-40db-470c-bac5-31a9dca57aea None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:47.566118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db746-40db-470c-bac5-31a9dca57aea None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:47.566319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db746-40db-470c-bac5-31a9dca57aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:47.614758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6e8db746-40db-470c-bac5-31a9dca57aea None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:47.616094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6e8db746-40db-470c-bac5-31a9dca57aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:47.625657 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1184/2364] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:47.637854 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1e975-6fcf-4895-9e75-42f89031f526 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:47.639702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4aa1e975-6fcf-4895-9e75-42f89031f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:47.746340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1e975-6fcf-4895-9e75-42f89031f526 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:47.750113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7150776-4191-4dda-b9de-7bd648857b94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:47.750808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7150776-4191-4dda-b9de-7bd648857b94 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:47.751090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7150776-4191-4dda-b9de-7bd648857b94 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:47.751366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7150776-4191-4dda-b9de-7bd648857b94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:47.764198 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7150776-4191-4dda-b9de-7bd648857b94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:47.765977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7150776-4191-4dda-b9de-7bd648857b94 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:47.780149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1181/2365] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:08:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:08:47.858569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc266b-07ce-4603-abcd-b1912eeec5b4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:47.858857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc266b-07ce-4603-abcd-b1912eeec5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:47.859136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc266b-07ce-4603-abcd-b1912eeec5b4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:47.860571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1185/2366] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:08:47.865530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5b16-05d0-4b07-933c-da8a9fe65a37 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:47.865814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5b16-05d0-4b07-933c-da8a9fe65a37 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:47.866117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5b16-05d0-4b07-933c-da8a9fe65a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:47.885404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dd3a5b16-05d0-4b07-933c-da8a9fe65a37 None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:47.886601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dd3a5b16-05d0-4b07-933c-da8a9fe65a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:47.939718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1182/2367] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:47.952709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc266b-07ce-4603-abcd-b1912eeec5b4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:47.964956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc266b-07ce-4603-abcd-b1912eeec5b4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:47.968743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e8a2-9e9c-4274-a446-558a2b876fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:47.969399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e8a2-9e9c-4274-a446-558a2b876fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:47.969680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e8a2-9e9c-4274-a446-558a2b876fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:47.969952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e8a2-9e9c-4274-a446-558a2b876fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:47.977766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e8a2-9e9c-4274-a446-558a2b876fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:47.979221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e8a2-9e9c-4274-a446-558a2b876fa9 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:47.987703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1186/2368] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:08:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:08:48.072873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9388-c139-4017-96d8-9bc5ecdf6bb6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:48.073162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9388-c139-4017-96d8-9bc5ecdf6bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:48.073446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9388-c139-4017-96d8-9bc5ecdf6bb6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:48.074899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1183/2369] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:08:48.080169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2da1-a396-43b6-af08-82324732f8f5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:48.080459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2da1-a396-43b6-af08-82324732f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:48.080738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2da1-a396-43b6-af08-82324732f8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:48.099961 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-be9e2da1-a396-43b6-af08-82324732f8f5 None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:48.101187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-be9e2da1-a396-43b6-af08-82324732f8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:48.110601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1187/2370] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:08:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:48.121418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe9388-c139-4017-96d8-9bc5ecdf6bb6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:48.133405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe9388-c139-4017-96d8-9bc5ecdf6bb6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:48.137128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:48.137778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:48.138062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:48.138341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:48.149638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:48.151085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:48.161915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1184/2371] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:08:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:08:51.806525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:51.807138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:51.807138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:51.827489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:08:51.828771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:08:51.836773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1188/2372] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:08:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:08:51.849600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:08:51.861372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd14e6-fe27-4ea1-9879-3aa2b3fd2a8f service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:08:51.867633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2c161-1e1c-48f0-89f1-70ee6810f809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:08:51.868317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c161-1e1c-48f0-89f1-70ee6810f809 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:08:51.868598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c161-1e1c-48f0-89f1-70ee6810f809 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:08:51.868864 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c161-1e1c-48f0-89f1-70ee6810f809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:08:51.878245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2c161-1e1c-48f0-89f1-70ee6810f809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:08:51.880077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2c161-1e1c-48f0-89f1-70ee6810f809 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:08:51.889946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1185/2373] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:09:01.821878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=24 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:01.886063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=70 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:12.264375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:09:12.278870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68ca7-e812-4bf2-ae4d-dfbf017ee487 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:09:12.282572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:09:12.283232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:12.283519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:12.283824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:12.293807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:09:12.295254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:09:12.305027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1189/2374] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:09:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:09:22.129718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:22.130235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:22.130332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:22.148282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:09:22.149480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:22.156715 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1186/2375] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 09:09:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:09:22.169482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:09:22.181192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe57d72-3e2c-46ee-8c7d-ba360340bfdd service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:09:22.186174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:09:22.186838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:22.187116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:22.187388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:22.195535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:09:22.197163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:09:22.205108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1190/2376] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:09:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:09:32.142710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:32.201889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=12 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:09:41.140349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:09:41.141789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:41.158061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a409354-8c47-44fc-962c-a3d26a519ea3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:09:41.163564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:09:41.164899 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:41.165173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:41.165445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:41.167170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:41.223973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:09:41.225595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:09:41.235633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1187/2377] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:09:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:09:41.327302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:09:41.328807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:41.414232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809ef3-1238-46f2-9d72-de84320339f1 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:09:41.417868 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:09:41.418520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:41.418804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:41.419082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:41.420872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:41.434145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:09:41.435585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:09:41.447005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1191/2378] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:09:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:09:43.423872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:09:43.425275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:43.437432 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af772c-10ab-42d3-a040-b161ff454a36 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:09:43.441058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:09:43.441753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:43.442038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:43.442317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:43.444116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:43.458034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:09:43.459511 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92974bf-11b2-401a-9b8e-b799ccceb302 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:09:43.470942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1188/2379] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:09:51.405396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:09:51.415349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be9d1-1e9b-4812-8dc0-143d18559dff service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:09:51.419074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:09:51.419851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:09:51.420199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:09:51.420540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:09:51.422388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:09:51.432872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:09:51.434314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:09:51.442608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1192/2380] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:09:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:09:53.465983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=34 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:01.438960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=41 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:11.589613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:11.590150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:11.590150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:11.607174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] MFA Rules not processed for user `3d8fbafbd63c4e1c946b414e2842eb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:10:11.608397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:11.662569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1189/2381] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:10:21.655738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=25 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:30.291078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:10:30.305738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883306c-6653-48ce-b44a-664d57b7003c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:10:30.311884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:10:30.312560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:30.312842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:30.313115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:30.315261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:30.381751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:10:30.384999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d975e8-4d83-4e98-9039-069d394cf321 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:10:30.396733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1193/2382] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:10:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:10:35.884975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:10:35.909696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfa50e-c8f1-4b7f-8b65-91e14255ec7d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:10:35.917312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:10:35.918562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:35.919206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:35.919965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:35.922641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:35.945043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:10:35.948601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:10:35.985131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1190/2383] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:10:39.790339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:39.790881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:39.791086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:39.808617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] MFA Rules not processed for user `22457f943fb84f0794695a132f93a3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:10:39.810018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:39.818188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1194/2384] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:10:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:10:40.123605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:10:40.125097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:40.137506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96887-e4b5-4d95-a745-528f30e73496 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:10:40.141119 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:10:40.141776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:40.142049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:40.142326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:40.144126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:40.154594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:10:40.156074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:10:40.164536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1191/2385] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:10:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:10:40.504665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:10:40.506338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:40.600428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96cee6-b593-42c4-8f4d-dbcd5907aa3b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:10:40.608992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:10:40.610029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:40.610549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:40.610928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:40.614111 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:40.627505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:10:40.629168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d05b9-a62c-4934-a0fc-27aec455a497 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:10:40.639981 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1195/2386] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:10:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:10:50.160716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=12 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:10:50.447290 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:10:50.466519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564744c-000b-4e6f-a871-537c70159181 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:10:50.472502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:10:50.473191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:10:50.473502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:10:50.473762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:10:50.475646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:10:50.496810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:10:50.498474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:10:50.511306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1192/2387] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:10:50.635427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=63 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:00.505531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:11.607027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:11.607563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:11.607666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:11.626194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] MFA Rules not processed for user `4a7b71aa00454406ab83a4891a8a719e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:11.627408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:11.635245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1196/2388] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:21.621278 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:24.175972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:24.186639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849fb7-6be1-469b-980a-c7e1600cc4ef service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:24.190253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:24.190889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:24.191173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:24.191482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:24.193364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:24.204320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:24.205757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499568d-3671-4035-93a0-2105c435ac86 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:24.214678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1193/2389] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:34.210712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:45.260514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:45.271047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b249cc-b788-40c5-a5a2-99e7a94a1715 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:45.276146 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:45.276902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:45.277253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:45.277754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:45.280411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:45.354315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:45.355976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:45.375388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1197/2390] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:46.302015 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:46.302633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:46.302633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:46.321596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] MFA Rules not processed for user `acbec87f607d4e00a2107c572fc68643`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:46.322862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:46.329991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1194/2391] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:46.691536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:46.701014 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3069-ff86-418b-91ed-9017bf7e995e service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:46.704754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:46.705422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:46.705700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:46.705974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:46.707802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:46.718140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:46.719630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:46.729073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1198/2392] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:49.231475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:49.233543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:49.248428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1612e22-406c-4984-a886-0d99ee64bf95 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:49.253525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:49.254498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:49.254675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:49.254947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:49.256755 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:49.269248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:49.270868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:49.282142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1195/2393] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:49.325186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:49.326681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:49.341553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b424cc5-454b-41fa-814e-eaeeb007bc0c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:49.346426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:49.347320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:49.347606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:49.347905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] PATH_INFO: `/v3/users/3d8fbafbd63c4e1c946b414e2842eb91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:49.349331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8fbafbd63c4e1c946b414e2842eb91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:49.351344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:49.403624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8fbafbd63c4e1c946b414e2842eb91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.419124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8fbafbd63c4e1c946b414e2842eb91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.419892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8fbafbd63c4e1c946b414e2842eb91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.427694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8fbafbd63c4e1c946b414e2842eb91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.440163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a83ea628-2caf-4b6e-89b3-624cf5aab004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8fbafbd63c4e1c946b414e2842eb91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.452599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1199/2394] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:11:49 2022] DELETE /identity/v3/users/3d8fbafbd63c4e1c946b414e2842eb91 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:49.735846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:49.751523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d64e-b6c9-4043-9f5b-3d861634c155 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:49.822127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:49.823007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:49.823287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:49.823567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] PATH_INFO: `/v3/projects/74e85f2b75a14a31ac1498fa9ac1d243` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:49.824891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e85f2b75a14a31ac1498fa9ac1d243)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:49.826825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:49.875831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e85f2b75a14a31ac1498fa9ac1d243', 'request_id': 'req-a8c2404b-3166-4a93-8970-acf0553e182a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.881304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e85f2b75a14a31ac1498fa9ac1d243', 'request_id': 'req-a8c2404b-3166-4a93-8970-acf0553e182a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.887547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e85f2b75a14a31ac1498fa9ac1d243', 'request_id': 'req-a8c2404b-3166-4a93-8970-acf0553e182a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.900961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] The token cache is being invalidate because project 74e85f2b75a14a31ac1498fa9ac1d243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:11:49.901495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.902138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a8c2404b-3166-4a93-8970-acf0553e182a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:49.903700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1196/2395] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:11:49 2022] DELETE /identity/v3/projects/74e85f2b75a14a31ac1498fa9ac1d243 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:49.908754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:49.909036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:49.909317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:49.929327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:49.931203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:49.993321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:50.011661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1200/2396] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:11:50.019988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.020309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.020558 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.043158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:50.044604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:50.057254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1197/2397] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:50.060696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.071570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22265-66db-4f63-a0c3-c8232926d994 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.076551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.077241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.077527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.077807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.078540 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:11:50.078886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.080526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.096798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1201/2398] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:11:50.097654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.108634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc588-1f43-486f-8b76-c4615a4e82b0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.114591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.115536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.115853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.116126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.116821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.119370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.177418 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1198/2399] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/projects => generated 361 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:11:50.179383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.197033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71207-2423-4c05-8c48-163454ab87eb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.282638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.283341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.283848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.284131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.284980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.287230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.313599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1202/2400] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:11:50.314907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.326741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2584-2bd3-4bcb-9fd2-892af498875a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.331836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.332553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.332909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.333249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.334061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.336035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.348147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1199/2401] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:50.352920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.367489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118316-c6ff-4201-add3-d6085471911b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.373425 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46728b8e-47c8-48eb-9c8e-44f729fb45d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.374198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46728b8e-47c8-48eb-9c8e-44f729fb45d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.374569 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46728b8e-47c8-48eb-9c8e-44f729fb45d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.374917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46728b8e-47c8-48eb-9c8e-44f729fb45d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.375785 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46728b8e-47c8-48eb-9c8e-44f729fb45d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.377490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46728b8e-47c8-48eb-9c8e-44f729fb45d8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.391112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1203/2402] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:50.395277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.406174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57263-0b82-4972-aa84-c71fa3bf23f5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.411270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.412344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.412533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.412978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] PATH_INFO: `/v3/projects/772b287ff701432898356bd9e210657f/users/1276206ad05d435ea538a2fcf734b110/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.430221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772b287ff701432898356bd9e210657f, user_id=1276206ad05d435ea538a2fcf734b110, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.433295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.442011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:50.449279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1200/2403] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:50 2022] PUT /identity/v3/projects/772b287ff701432898356bd9e210657f/users/1276206ad05d435ea538a2fcf734b110/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:50.459737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.460052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.460380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.488628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] MFA Rules not processed for user `1276206ad05d435ea538a2fcf734b110`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:50.489992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:50.562154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1204/2404] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:50.566618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.630455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ecbe-b4f7-44ef-b665-6ce4b0953694 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.635844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.636587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.636944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.637230 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.637984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.639897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.671443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1201/2405] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:11:50.672487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.683857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bce34-aa11-4580-9c6e-e466996f8f57 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.730214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:50.743007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.743714 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.744030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.744304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.744994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.746953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.768025 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1205/2406] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:11:50.771955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.784447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408cc70-8d16-4a6e-afff-0074da22b07e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.790462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.791491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.791713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.791987 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.792724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.794440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.806188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1202/2407] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:11:50.810226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.821381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2a544-482f-4e1d-8fb2-7d5ca30d7f2a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.826206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.827108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.827391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.827670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] PATH_INFO: `/v3/projects/b67de74228804c869b99a0616ccd02bb/users/31b7186f54a5423d89249eef65907de9/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.843397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67de74228804c869b99a0616ccd02bb, user_id=31b7186f54a5423d89249eef65907de9, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.846144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.860367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1206/2408] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:50 2022] PUT /identity/v3/projects/b67de74228804c869b99a0616ccd02bb/users/31b7186f54a5423d89249eef65907de9/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:50.864291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.874693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3967a-5c2d-490d-a22d-ed3d45d6181b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.930670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce399c2-3d32-4b9e-aed6-803458708838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.931859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce399c2-3d32-4b9e-aed6-803458708838 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.932170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce399c2-3d32-4b9e-aed6-803458708838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.932460 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce399c2-3d32-4b9e-aed6-803458708838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.933236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce399c2-3d32-4b9e-aed6-803458708838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.934868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce399c2-3d32-4b9e-aed6-803458708838 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.944611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1203/2409] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:11:50.948772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:50.959326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a1ffe-68d4-485d-a06d-7c3a53273cbc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:50.964605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:50.965523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.965811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.966086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] PATH_INFO: `/v3/projects/b67de74228804c869b99a0616ccd02bb/users/31b7186f54a5423d89249eef65907de9/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:50.968103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67de74228804c869b99a0616ccd02bb, user_id=31b7186f54a5423d89249eef65907de9, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:50.970844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:50.982177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1207/2410] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:50 2022] PUT /identity/v3/projects/b67de74228804c869b99a0616ccd02bb/users/31b7186f54a5423d89249eef65907de9/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:50.992595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:50.992940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:50.993293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:51.019767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] MFA Rules not processed for user `31b7186f54a5423d89249eef65907de9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:51.021011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:51.079147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:51.090492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1204/2411] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:51.101709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:51.104063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:51.162554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16040e35-8073-44bf-b724-3e4e5581be6e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:51.166884 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8970b9-4a93-4373-8da7-75c50a92f97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:51.167615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8970b9-4a93-4373-8da7-75c50a92f97b service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:51.167832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8970b9-4a93-4373-8da7-75c50a92f97b service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:51.168108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8970b9-4a93-4373-8da7-75c50a92f97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:51.177030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8970b9-4a93-4373-8da7-75c50a92f97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:51.178463 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8970b9-4a93-4373-8da7-75c50a92f97b service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:51.187783 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1208/2412] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:51.587437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:51.650950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ded64-f7df-45fc-9a54-53c59dca0264 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:51.656142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:51.657060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:51.657344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:51.657693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] PATH_INFO: `/v3/users/1276206ad05d435ea538a2fcf734b110` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:51.658889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1276206ad05d435ea538a2fcf734b110)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:51.661140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:51.710995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1276206ad05d435ea538a2fcf734b110'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:51.723522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1276206ad05d435ea538a2fcf734b110'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:51.731125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1276206ad05d435ea538a2fcf734b110'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:51.731869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1276206ad05d435ea538a2fcf734b110'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:51.740894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1276206ad05d435ea538a2fcf734b110'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:51.747266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1205/2413] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:11:51 2022] DELETE /identity/v3/users/1276206ad05d435ea538a2fcf734b110 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:51.751912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:51.752411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:51.752614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:51.771081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:51.772411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:51.837915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1209/2414] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:11:51.848430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:51.850621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:51.918268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccc6c-bec0-4b85-b3d2-40517fda9971 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:51.922538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:51.923199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:51.923616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:51.923926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:51.935021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:51.936505 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:51.946844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1206/2415] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:52.303640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:52.305257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:52.327312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c639d8d-b44e-4568-b39a-d7acd7289421 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:52.335427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:52.337231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:52.337572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:52.337848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] PATH_INFO: `/v3/projects/772b287ff701432898356bd9e210657f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:52.339071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772b287ff701432898356bd9e210657f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:52.341307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:52.384883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:52.393896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772b287ff701432898356bd9e210657f', 'request_id': 'req-25b58fd9-88c6-4845-9a8f-71834fb30121'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.400649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772b287ff701432898356bd9e210657f', 'request_id': 'req-25b58fd9-88c6-4845-9a8f-71834fb30121'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.408359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772b287ff701432898356bd9e210657f', 'request_id': 'req-25b58fd9-88c6-4845-9a8f-71834fb30121'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.420881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] The token cache is being invalidate because project 772b287ff701432898356bd9e210657f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:11:52.421154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.421790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.423436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1210/2416] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:11:52 2022] DELETE /identity/v3/projects/772b287ff701432898356bd9e210657f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:52.427405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:52.437826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95822-8a1b-4de7-a08a-028bdda1b667 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:52.450856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:52.513560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:52.514356 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:52.514641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:52.514919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] PATH_INFO: `/v3/users/31b7186f54a5423d89249eef65907de9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:52.516162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b7186f54a5423d89249eef65907de9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:52.518117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:52.566321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b7186f54a5423d89249eef65907de9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.578227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b7186f54a5423d89249eef65907de9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.585246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b7186f54a5423d89249eef65907de9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.585930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b7186f54a5423d89249eef65907de9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.594892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b11274a6-1163-4fdc-8206-aa225e580759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b7186f54a5423d89249eef65907de9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:52.600906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1207/2417] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:11:52 2022] DELETE /identity/v3/users/31b7186f54a5423d89249eef65907de9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:52.883231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:52.884814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:52.898022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b58fd9-88c6-4845-9a8f-71834fb30121 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:52.957389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:52.958265 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:52.958546 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:52.958819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] PATH_INFO: `/v3/projects/b67de74228804c869b99a0616ccd02bb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:52.960034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67de74228804c869b99a0616ccd02bb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:52.961993 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.009756 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67de74228804c869b99a0616ccd02bb', 'request_id': 'req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:53.015250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67de74228804c869b99a0616ccd02bb', 'request_id': 'req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:53.022914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67de74228804c869b99a0616ccd02bb', 'request_id': 'req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:53.034189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] The token cache is being invalidate because project b67de74228804c869b99a0616ccd02bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:11:53.034488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:53.035375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11797eaa-b0cf-44ad-9e1f-c31fc24bf027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:53.036982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1211/2418] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:11:52 2022] DELETE /identity/v3/projects/b67de74228804c869b99a0616ccd02bb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:53.042486 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.042777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.043055 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.061292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:53.062423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:53.132184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1208/2419] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:53.141880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.142165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.142444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.161823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:53.162629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:53.171199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1212/2420] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:53.176840 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.187266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fad8a-7f33-4fd9-ac7f-12788308533e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.192007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.192678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.193024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.193307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.194053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:11:53.194326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.195939 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.207748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1209/2421] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:11:53.212648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.222004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265eda-34d5-429d-9ccf-23c18e3e92ed None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.227537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.228244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.228520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.228791 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.229491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.231488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.257747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1213/2422] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:11:53.261979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.272530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fffbe-75a3-4995-a4ce-7c279596ab9d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.292975 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:53.333950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.334525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.334812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.335089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.335818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.338259 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.358554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1210/2423] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:11:53.362607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.372866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f7e6-307a-4170-bd47-2dec79238e7f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.377882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.378566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.378853 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.379130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.379885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.381502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.391994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1214/2424] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:53.396033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.406545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a62e1-a7c6-4f02-933f-0f30d9bf0741 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.411577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236195c6-2b47-46c6-ba45-cce28aaaab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.412261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236195c6-2b47-46c6-ba45-cce28aaaab0a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.412547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236195c6-2b47-46c6-ba45-cce28aaaab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.412823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236195c6-2b47-46c6-ba45-cce28aaaab0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.413576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236195c6-2b47-46c6-ba45-cce28aaaab0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.416214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236195c6-2b47-46c6-ba45-cce28aaaab0a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.426300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1211/2425] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:53.430399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.440712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc842bc-2d94-4beb-925f-d9306b1de256 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.445966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.446888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.447187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.447484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] PATH_INFO: `/v3/projects/45b932ea9f8f4a2a9ca95a6c66d66ce5/users/de6ffb4dbf604969ac5e94962a8a52b7/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.463588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b932ea9f8f4a2a9ca95a6c66d66ce5, user_id=de6ffb4dbf604969ac5e94962a8a52b7, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.466342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.468587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:53.482935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1215/2426] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:53 2022] PUT /identity/v3/projects/45b932ea9f8f4a2a9ca95a6c66d66ce5/users/de6ffb4dbf604969ac5e94962a8a52b7/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:53.493126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.493416 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.493693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.520000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] MFA Rules not processed for user `de6ffb4dbf604969ac5e94962a8a52b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:53.521204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:53.589659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1212/2427] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:53.594037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.654945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafdbdc-6ebc-463b-bf25-d9eaf52428c2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.659660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.660598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.660881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.661156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.661839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.663748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.689294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1216/2428] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:11:53.693443 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.704773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca980e-d033-40d5-9c96-cb556ac6f3f1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.760953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.761625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.761930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.762205 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.762886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.764883 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.785032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1213/2429] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:11:53 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:11:53.789354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.799941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067605e-5216-449e-9bc6-70012ea89895 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.804607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.805264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.805581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.805860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.806609 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.808248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.819917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1217/2430] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:53.824596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.834602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54eb08-ac78-4880-933a-2683675bdd82 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.839835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.840675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.840958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.841232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] PATH_INFO: `/v3/projects/0f3b1e65b1134c0e818edff17c67c540/users/88533cf311944923b0b5fbdc5628f845/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.855967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3b1e65b1134c0e818edff17c67c540, user_id=88533cf311944923b0b5fbdc5628f845, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.858659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.861681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:53.872969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1214/2431] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:53 2022] PUT /identity/v3/projects/0f3b1e65b1134c0e818edff17c67c540/users/88533cf311944923b0b5fbdc5628f845/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:53.876905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.887428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f827dd7-3857-4ded-85e7-dbb0ea5018f3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.944039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22764b-9b61-4d62-8853-dc4e11a4398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.944742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22764b-9b61-4d62-8853-dc4e11a4398a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.945029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22764b-9b61-4d62-8853-dc4e11a4398a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.945307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22764b-9b61-4d62-8853-dc4e11a4398a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.946046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22764b-9b61-4d62-8853-dc4e11a4398a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.948338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22764b-9b61-4d62-8853-dc4e11a4398a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.958673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1218/2432] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:53.962857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:53.973312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d1f7-e9a6-4231-8a1e-7c95957f0209 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:53.978110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:53.979009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:53.979292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:53.979568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] PATH_INFO: `/v3/projects/0f3b1e65b1134c0e818edff17c67c540/users/88533cf311944923b0b5fbdc5628f845/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:53.981553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3b1e65b1134c0e818edff17c67c540, user_id=88533cf311944923b0b5fbdc5628f845, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:53.984262 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:53.995648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1215/2433] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:53 2022] PUT /identity/v3/projects/0f3b1e65b1134c0e818edff17c67c540/users/88533cf311944923b0b5fbdc5628f845/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:54.006615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:54.006902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:54.007178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:54.034448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] MFA Rules not processed for user `88533cf311944923b0b5fbdc5628f845`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:54.035963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:54.084856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:54.104222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1219/2434] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:54.115115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:54.116835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:54.174559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a956e-8168-415f-9256-9e66f8f49689 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:54.178224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975f197-a398-44fd-a331-6063334b5456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:54.178892 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f197-a398-44fd-a331-6063334b5456 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:54.179180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f197-a398-44fd-a331-6063334b5456 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:54.179459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f197-a398-44fd-a331-6063334b5456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:54.188996 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f197-a398-44fd-a331-6063334b5456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:54.190451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f197-a398-44fd-a331-6063334b5456 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:54.200804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1216/2435] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:54.229520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:54.294824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d499d6-6c17-4e78-8092-03e2b848ce7d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:54.301332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:54.302230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:54.302683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:54.302958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] PATH_INFO: `/v3/users/de6ffb4dbf604969ac5e94962a8a52b7` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:54.304201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6ffb4dbf604969ac5e94962a8a52b7)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:54.306946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:54.356225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6ffb4dbf604969ac5e94962a8a52b7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.369650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6ffb4dbf604969ac5e94962a8a52b7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.370472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6ffb4dbf604969ac5e94962a8a52b7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.378744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6ffb4dbf604969ac5e94962a8a52b7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.386208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6ffb4dbf604969ac5e94962a8a52b7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.392470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1220/2436] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:11:54 2022] DELETE /identity/v3/users/de6ffb4dbf604969ac5e94962a8a52b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:54.397001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:54.397343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:54.397664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:54.416428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:54.417625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:54.481569 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1217/2437] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:54.491261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:54.492759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:54.550124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8300c2-f009-4c97-936c-25b065b75f1a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:54.553823 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:54.555022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:54.555022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:54.555022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:54.565820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:54.567271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:54.578093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1221/2438] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:54.845552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:54.847076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:54.859866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529ce1f-018f-4f91-a28e-626dd9ac10b1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:54.864634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:54.865510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:54.865798 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:54.866074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] PATH_INFO: `/v3/projects/45b932ea9f8f4a2a9ca95a6c66d66ce5` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:54.867268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b932ea9f8f4a2a9ca95a6c66d66ce5)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:54.869257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:54.917462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b932ea9f8f4a2a9ca95a6c66d66ce5', 'request_id': 'req-780fd07b-f583-4c66-8d4a-821346169380'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.922850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b932ea9f8f4a2a9ca95a6c66d66ce5', 'request_id': 'req-780fd07b-f583-4c66-8d4a-821346169380'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.929038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b932ea9f8f4a2a9ca95a6c66d66ce5', 'request_id': 'req-780fd07b-f583-4c66-8d4a-821346169380'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.941771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] The token cache is being invalidate because project 45b932ea9f8f4a2a9ca95a6c66d66ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:11:54.942060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.942686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:54.944468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1218/2439] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:11:54 2022] DELETE /identity/v3/projects/45b932ea9f8f4a2a9ca95a6c66d66ce5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:54.948602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:54.958325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a8e1-1abb-460b-8325-45bca9cfb6c0 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:54.966925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:55.019099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.020016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.020302 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.020580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] PATH_INFO: `/v3/users/88533cf311944923b0b5fbdc5628f845` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.021761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] RBAC: Authorizing `identity:delete_user(user_id=88533cf311944923b0b5fbdc5628f845)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.023699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.069181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88533cf311944923b0b5fbdc5628f845'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.081590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88533cf311944923b0b5fbdc5628f845'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.082259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88533cf311944923b0b5fbdc5628f845'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.089770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88533cf311944923b0b5fbdc5628f845'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.097114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e9868029-4c6c-4ec5-951a-c6116072ccca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88533cf311944923b0b5fbdc5628f845'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.103060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1222/2440] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:11:54 2022] DELETE /identity/v3/users/88533cf311944923b0b5fbdc5628f845 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:55.368764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.370245 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:55.385018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fd07b-f583-4c66-8d4a-821346169380 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.390852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:55.449861 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.450657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.450943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.451222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] PATH_INFO: `/v3/projects/0f3b1e65b1134c0e818edff17c67c540` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.452660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3b1e65b1134c0e818edff17c67c540)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.454636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.502226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3b1e65b1134c0e818edff17c67c540', 'request_id': 'req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.508469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3b1e65b1134c0e818edff17c67c540', 'request_id': 'req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.515194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3b1e65b1134c0e818edff17c67c540', 'request_id': 'req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.528456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] The token cache is being invalidate because project 0f3b1e65b1134c0e818edff17c67c540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:11:55.528746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.529379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d959ae9-8e9e-4e81-b5e5-88beca7f4e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:11:55.531184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1219/2441] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:11:55 2022] DELETE /identity/v3/projects/0f3b1e65b1134c0e818edff17c67c540 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:55.536269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.536557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.536833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.554310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:55.556447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:55.621848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1223/2442] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:11:55.630448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.630738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.631018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.649851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:55.651071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:55.658919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1220/2443] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:55.663466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.673403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a9af2-fbec-4838-b036-a873a4e70194 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.678024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.678676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.678958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.679234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.680010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:11:55.680317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.682604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.694538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1224/2444] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:11:55.699578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.709078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8273b-583b-4757-9281-86d8950b7734 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.713724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.714377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.714662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.714938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.715659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.717636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.743532 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1221/2445] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:11:55 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:11:55.747742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.757926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727feac-6db7-43ac-a87c-b0168671b917 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.770536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:55.817296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.817989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.818257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.818570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.819224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.821203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.840099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1225/2446] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:11:55 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:11:55.844781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.856802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad542ef3-ab70-42ef-8066-a26b7d1c445d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.861405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.862060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.862334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.862630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.863343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.865009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.876062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1222/2447] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:55.880346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.890368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6f7cb-a448-4190-9d58-d9d4468f1008 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.894987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd488-ed40-473d-b5a3-5e87792ad0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.895646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd488-ed40-473d-b5a3-5e87792ad0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.895960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd488-ed40-473d-b5a3-5e87792ad0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.896237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd488-ed40-473d-b5a3-5e87792ad0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.896958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd488-ed40-473d-b5a3-5e87792ad0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.898568 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd488-ed40-473d-b5a3-5e87792ad0d5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.909446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1226/2448] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:55.912909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:55.923469 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116935-54a0-479c-9fec-1853e9a54748 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:55.928154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:55.929031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.929317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.929597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] PATH_INFO: `/v3/projects/7c926ce1458a4600a8085d401b35c4d2/users/bad819752e8f411f807c857945424206/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.944563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c926ce1458a4600a8085d401b35c4d2, user_id=bad819752e8f411f807c857945424206, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:55.947237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:55.960484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1223/2449] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:55 2022] PUT /identity/v3/projects/7c926ce1458a4600a8085d401b35c4d2/users/bad819752e8f411f807c857945424206/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:11:55.965736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8da88-5142-40d0-b525-024650a9397c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:55.966209 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8da88-5142-40d0-b525-024650a9397c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:55.966301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8da88-5142-40d0-b525-024650a9397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:55.984878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-98d8da88-5142-40d0-b525-024650a9397c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:55.986102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-98d8da88-5142-40d0-b525-024650a9397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:56.045986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1227/2450] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:56.055234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:56.057557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:56.095951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:56.118906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1b23-c011-4eae-b94d-43a4ae727ac9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:56.124761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:56.125426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:56.125763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:56.127147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:56.136615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:56.138073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:56.148128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1224/2451] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:56.861409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:56.861687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:56.861995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:56.890375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] MFA Rules not processed for user `bad819752e8f411f807c857945424206`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:56.891627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:56.962007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1228/2452] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:56.967962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:56.978655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ca26b-7f8d-4ce6-aa06-889679c03c9f service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:56.983928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:56.984604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:56.984889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:56.985167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:56.986014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:56.987852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:57.015946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1225/2453] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:11:57.019974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:57.031249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f96f7-bb2e-4283-86a9-f9fb8be1cf59 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:57.056470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:11:57.089085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:57.089762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:57.090045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:57.090326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:57.091008 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:57.092988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:57.112422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1229/2454] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:11:57 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:11:57.116567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:57.127679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf7e5-4e52-4d78-9dd8-adc8eea5ac6f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:57.132240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:57.132893 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:57.133172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:57.133445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:57.135024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:57.136675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:57.147940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1226/2455] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:57.152419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:57.162655 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6557-6e5c-41fb-9217-3f830d250bc4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:57.167207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:57.168117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:57.168396 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:57.168667 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] PATH_INFO: `/v3/projects/5c92a7df36d743f38b14b5f00bd0b669/users/c9bfa91f58c74f11a7755dde45d98ecd/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:57.183608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c92a7df36d743f38b14b5f00bd0b669, user_id=c9bfa91f58c74f11a7755dde45d98ecd, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:57.186341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:57.200866 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1230/2456] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:57 2022] PUT /identity/v3/projects/5c92a7df36d743f38b14b5f00bd0b669/users/c9bfa91f58c74f11a7755dde45d98ecd/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:57.204821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:57.215047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e51281-23ad-46f5-b9eb-5be103e127b7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:57.271250 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7135097-71f7-486f-875b-7c207ca6d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:57.271971 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7135097-71f7-486f-875b-7c207ca6d3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:57.272242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7135097-71f7-486f-875b-7c207ca6d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:57.272522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7135097-71f7-486f-875b-7c207ca6d3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:57.273247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7135097-71f7-486f-875b-7c207ca6d3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:57.274909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7135097-71f7-486f-875b-7c207ca6d3b2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:57.284909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1227/2457] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:11:57.290492 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:57.301137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c3185-6a23-448b-9cef-765a78272705 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:57.306354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:57.307239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:57.307560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:57.307867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] PATH_INFO: `/v3/projects/5c92a7df36d743f38b14b5f00bd0b669/users/c9bfa91f58c74f11a7755dde45d98ecd/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:57.309839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c92a7df36d743f38b14b5f00bd0b669, user_id=c9bfa91f58c74f11a7755dde45d98ecd, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:57.312530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:57.322817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1231/2458] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:11:57 2022] PUT /identity/v3/projects/5c92a7df36d743f38b14b5f00bd0b669/users/c9bfa91f58c74f11a7755dde45d98ecd/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:11:57.967332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:57.967332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:57.967332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:58.001478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] MFA Rules not processed for user `c9bfa91f58c74f11a7755dde45d98ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:11:58.002741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:58.082462 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1228/2459] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:11:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:11:58.094257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:58.096107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:58.157423 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bde8d-f2e9-4513-9963-6396407829ed admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:58.161366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:58.162021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:58.162306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:58.162584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:58.218226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:58.219672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:58.228709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1232/2460] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:11:59.573024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:11:59.574473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:11:59.586266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f2e4-d954-4f60-b440-386166039a13 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:11:59.591739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:11:59.591739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:11:59.591739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:11:59.592615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:11:59.602656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:11:59.604129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:11:59.613549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1229/2461] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:11:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:08.224555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=80,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:09.609371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:12.011122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:12.013487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:12.098857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d460639-14ba-45d1-afaa-7fb71d7285f6 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:12.105040 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:12.105696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:12.105973 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:12.106251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:12.108058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:12.119878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:12.121514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:12.132498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1233/2462] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:12.592689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:12.657601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5455a-a45b-4dec-b9bb-945a44b02144 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:12.662391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:12.663258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:12.663537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:12.663836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] PATH_INFO: `/v3/users/bad819752e8f411f807c857945424206` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:12.665025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad819752e8f411f807c857945424206)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:12.667623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:12.713496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad819752e8f411f807c857945424206'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:12.725275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad819752e8f411f807c857945424206'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:12.732905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad819752e8f411f807c857945424206'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:12.733585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad819752e8f411f807c857945424206'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:12.741575 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad819752e8f411f807c857945424206'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:12.747600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1230/2463] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:12:12 2022] DELETE /identity/v3/users/bad819752e8f411f807c857945424206 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:12.920505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:12.931141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c98fb-1036-42b8-82f8-7d0772fbeb25 service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:12.990127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:12.991116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:12.991401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:12.991673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] PATH_INFO: `/v3/projects/7c926ce1458a4600a8085d401b35c4d2` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:12.992919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c926ce1458a4600a8085d401b35c4d2)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:12.994878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.041885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c926ce1458a4600a8085d401b35c4d2', 'request_id': 'req-410c594b-20d4-46f1-a453-df072276af0f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.047343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c926ce1458a4600a8085d401b35c4d2', 'request_id': 'req-410c594b-20d4-46f1-a453-df072276af0f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.054789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c926ce1458a4600a8085d401b35c4d2', 'request_id': 'req-410c594b-20d4-46f1-a453-df072276af0f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.065872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] The token cache is being invalidate because project 7c926ce1458a4600a8085d401b35c4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:12:13.066162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.066797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.068375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1234/2464] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:12:12 2022] DELETE /identity/v3/projects/7c926ce1458a4600a8085d401b35c4d2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:13.072904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.074324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:13.087420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b5a94-eed6-438d-9a62-80a8100cf0e9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.145662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.146535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.146817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.147090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] PATH_INFO: `/v3/users/c9bfa91f58c74f11a7755dde45d98ecd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.148292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bfa91f58c74f11a7755dde45d98ecd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.150907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.172135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:13.196959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bfa91f58c74f11a7755dde45d98ecd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.209340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bfa91f58c74f11a7755dde45d98ecd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.216831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bfa91f58c74f11a7755dde45d98ecd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.217517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bfa91f58c74f11a7755dde45d98ecd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.225867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb88fa95-3932-4f33-ba03-2a829649e810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bfa91f58c74f11a7755dde45d98ecd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.232240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1231/2465] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:12:13 2022] DELETE /identity/v3/users/c9bfa91f58c74f11a7755dde45d98ecd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:13.404846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.406287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:13.420658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c594b-20d4-46f1-a453-df072276af0f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.438617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:13.480525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.481395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.481672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.481937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] PATH_INFO: `/v3/projects/5c92a7df36d743f38b14b5f00bd0b669` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.483159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c92a7df36d743f38b14b5f00bd0b669)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.485100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.531738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c92a7df36d743f38b14b5f00bd0b669', 'request_id': 'req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.537681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c92a7df36d743f38b14b5f00bd0b669', 'request_id': 'req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.545153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c92a7df36d743f38b14b5f00bd0b669', 'request_id': 'req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.555989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] The token cache is being invalidate because project 5c92a7df36d743f38b14b5f00bd0b669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:12:13.556279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.557403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2cd6e97d-99b4-4894-8f9e-a8390eb2d9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:13.558921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1235/2466] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:12:13 2022] DELETE /identity/v3/projects/5c92a7df36d743f38b14b5f00bd0b669 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:13.563808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.564099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.564374 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.582799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:13.583956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:13.647496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1232/2467] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:13.655298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.655590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.655914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.674363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:13.675565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:13.685908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1236/2468] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:13.690179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.701644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b4422-d125-4f24-8f97-2d3af707c09b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.706471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.707234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.707516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.707822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.708549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:12:13.708855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.710448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.722220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1233/2469] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:12:13.726732 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.736308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d37f3-091d-4566-866b-737836ed72d4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.740944 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.741590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.741869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.742136 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.742820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.745282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.771537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1237/2470] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:12:13 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:12:13.775887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.785991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7d2d-568b-476e-9c74-96079443ed9c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.844675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.845277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.845562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.845847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.846561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.848553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.870306 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1234/2471] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:12:13 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:12:13.874618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.884920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522e422-4d93-4566-9b01-599113eb281c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.889581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.890240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.890526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.890807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.891529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.893182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.903707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1238/2472] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:12:13.907610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.918227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0d09b-fe9b-4820-9b03-a215180181dc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.922828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b302-ac59-4ad7-8faf-0b56e00a12cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.923466 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b302-ac59-4ad7-8faf-0b56e00a12cb admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.923747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b302-ac59-4ad7-8faf-0b56e00a12cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.924045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b302-ac59-4ad7-8faf-0b56e00a12cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.926623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b302-ac59-4ad7-8faf-0b56e00a12cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.928343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b302-ac59-4ad7-8faf-0b56e00a12cb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.939610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1235/2473] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:12:13.943680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:13.953621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405e78-2119-45f9-8482-8c8fc4d8c288 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:13.958206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:13.959079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:13.959357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:13.959626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] PATH_INFO: `/v3/projects/ff77a5ebb0e64c09832a486bb97f0920/users/87f07c76752a4b18b6a7f56b3a84f9b0/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:13.975270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff77a5ebb0e64c09832a486bb97f0920, user_id=87f07c76752a4b18b6a7f56b3a84f9b0, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:13.977991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:13.992035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1239/2474] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:12:13 2022] PUT /identity/v3/projects/ff77a5ebb0e64c09832a486bb97f0920/users/87f07c76752a4b18b6a7f56b3a84f9b0/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:14.002929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.003226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.003539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.010219 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:14.031108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] MFA Rules not processed for user `87f07c76752a4b18b6a7f56b3a84f9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:14.032332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:14.096501 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1236/2475] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:14.108020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:14.109812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:14.161945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:14.169617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6480cc-61bb-4b6e-a2ea-f81e6453b6b3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:14.173919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320717c-55b1-49e7-ade3-896b11abc6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:14.174575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320717c-55b1-49e7-ade3-896b11abc6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.174861 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320717c-55b1-49e7-ade3-896b11abc6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.175139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320717c-55b1-49e7-ade3-896b11abc6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.183614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320717c-55b1-49e7-ade3-896b11abc6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:14.185096 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320717c-55b1-49e7-ade3-896b11abc6f3 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:14.194258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1240/2476] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:12:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:14.213804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:14.276354 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1dc7-5e39-47fa-8635-90293c4b52d5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:14.281199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:14.282263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.282580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.282857 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] PATH_INFO: `/v3/users/87f07c76752a4b18b6a7f56b3a84f9b0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.284156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f07c76752a4b18b6a7f56b3a84f9b0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:14.286428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:14.333081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f07c76752a4b18b6a7f56b3a84f9b0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.345349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f07c76752a4b18b6a7f56b3a84f9b0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.352430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f07c76752a4b18b6a7f56b3a84f9b0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.353063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f07c76752a4b18b6a7f56b3a84f9b0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.360822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f07c76752a4b18b6a7f56b3a84f9b0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.366885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1237/2477] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:12:14 2022] DELETE /identity/v3/users/87f07c76752a4b18b6a7f56b3a84f9b0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:14.373338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.373730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.374072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.391116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:14.392371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:14.450033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1241/2478] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:14.459490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:14.460921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:14.475909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:14.521704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17f3b3-d499-49e4-9616-fe0ace8e4c55 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:14.526130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91fb74-b4c0-4708-b8be-3a59a116edc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:14.526786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91fb74-b4c0-4708-b8be-3a59a116edc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.527073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91fb74-b4c0-4708-b8be-3a59a116edc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.527350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91fb74-b4c0-4708-b8be-3a59a116edc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.536963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91fb74-b4c0-4708-b8be-3a59a116edc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:14.538404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91fb74-b4c0-4708-b8be-3a59a116edc8 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:14.547886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1238/2479] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:14.817211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:14.818905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:14.832020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e54f8-1947-44fa-898e-5c55af017f3b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:14.836726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:14.837594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.838476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.838748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] PATH_INFO: `/v3/projects/ff77a5ebb0e64c09832a486bb97f0920` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.839962 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff77a5ebb0e64c09832a486bb97f0920)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:14.841880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:14.890142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff77a5ebb0e64c09832a486bb97f0920', 'request_id': 'req-994b2c08-e697-4973-be2b-73badbb4bcf5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.895978 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff77a5ebb0e64c09832a486bb97f0920', 'request_id': 'req-994b2c08-e697-4973-be2b-73badbb4bcf5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.903130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff77a5ebb0e64c09832a486bb97f0920', 'request_id': 'req-994b2c08-e697-4973-be2b-73badbb4bcf5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.914156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] The token cache is being invalidate because project ff77a5ebb0e64c09832a486bb97f0920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:12:14.914442 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.915080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-994b2c08-e697-4973-be2b-73badbb4bcf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:12:14.916633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1242/2480] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:12:14 2022] DELETE /identity/v3/projects/ff77a5ebb0e64c09832a486bb97f0920 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:14.921494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:14.921966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:14.922061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:14.941224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:14.942450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:15.004260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1239/2481] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:15.068186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.068476 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.068757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.087618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:15.088842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:15.096874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1243/2482] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:15.101028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.110782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333623-7a2a-4ff0-a7e8-7d000eb7e886 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.115307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.116039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.116266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.116540 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.117254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:12:15.117556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.119666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.131030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1240/2483] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:12:15.135891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.145245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b198e4-529b-4d87-a124-c8ca428387d1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.149841 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.150493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.150779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.151059 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.151770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.153703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.178907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1244/2484] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:12:15 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:12:15.183451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.193335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4a8c4-bc98-43c7-8047-4abb09133797 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.250720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.251396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.251681 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.252014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.252706 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.254664 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.276134 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1241/2485] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:12:15 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:12:15.280188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.292115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f48bfe-6fda-42a5-83d1-40dd578b08ff admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.296825 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.297491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.298032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.298320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.299047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.300703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.312579 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1245/2486] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:12:15.316621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.326810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a016-87c2-4684-bb1f-a4bc11820fc9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.331745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c00330-38e9-4762-90fd-f5e239276f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.332454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c00330-38e9-4762-90fd-f5e239276f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.332770 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c00330-38e9-4762-90fd-f5e239276f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.333048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c00330-38e9-4762-90fd-f5e239276f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.334130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c00330-38e9-4762-90fd-f5e239276f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.336159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c00330-38e9-4762-90fd-f5e239276f95 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.346576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1242/2487] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:12:15.350803 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.361626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c49b4-9b26-4a8f-8a60-039ba7f6ed2e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.366239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.367139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.367403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.367680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] PATH_INFO: `/v3/projects/550b6a4abd9342caa18f150846d0277d/users/544a8ed11787431db393494eefcba2e6/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.382539 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550b6a4abd9342caa18f150846d0277d, user_id=544a8ed11787431db393494eefcba2e6, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.385355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.397998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1246/2488] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:12:15 2022] PUT /identity/v3/projects/550b6a4abd9342caa18f150846d0277d/users/544a8ed11787431db393494eefcba2e6/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:12:15.403129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae17d7d-4fb9-4d88-a1b0-c1e7ce67b204 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.403461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae17d7d-4fb9-4d88-a1b0-c1e7ce67b204 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.403738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae17d7d-4fb9-4d88-a1b0-c1e7ce67b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.422566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ae17d7d-4fb9-4d88-a1b0-c1e7ce67b204 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:15.423822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ae17d7d-4fb9-4d88-a1b0-c1e7ce67b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:15.440934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:15.485232 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1243/2489] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:15.495991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:15.497673 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:15.508769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:15.557899 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25334aa2-3d1d-4d66-bce3-177bb32fe104 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:15.561601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:15.562242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:15.562523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:15.562800 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:15.571872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:15.573325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:15.582689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1247/2490] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:16.209657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e8bb-7abe-4b39-8fb9-c9eca1443e27 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:16.210190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e8bb-7abe-4b39-8fb9-c9eca1443e27 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:16.210190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e8bb-7abe-4b39-8fb9-c9eca1443e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:16.242209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f0c0e8bb-7abe-4b39-8fb9-c9eca1443e27 None None] MFA Rules not processed for user `544a8ed11787431db393494eefcba2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:16.244099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f0c0e8bb-7abe-4b39-8fb9-c9eca1443e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:16.323635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1244/2491] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:16.334411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:16.335863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:16.396259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3e553-d28a-4d86-9856-e2733bd6c5d7 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:16.399989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:16.400680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:16.400965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:16.401264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:16.410264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:16.411709 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:16.421637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1248/2492] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:12:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:17.765521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576124c-89b5-49b1-a89a-9ab58cc0cb89 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:17.766038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576124c-89b5-49b1-a89a-9ab58cc0cb89 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:17.766133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576124c-89b5-49b1-a89a-9ab58cc0cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:17.784222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f576124c-89b5-49b1-a89a-9ab58cc0cb89 None None] MFA Rules not processed for user `544a8ed11787431db393494eefcba2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:17.785687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f576124c-89b5-49b1-a89a-9ab58cc0cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:17.792634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1245/2493] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:26.417457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=48 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:27.778844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=52 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:41.810645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:41.812079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:41.881534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d69eb-8970-4197-b2d7-23fc17ebb988 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:41.886698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:41.887347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:41.887634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:41.888006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:41.889811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:41.901095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:41.903204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:41.913343 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1249/2494] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:12:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:12:44.221711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3781d64-ea85-4865-a087-82b694c3fbfc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:44.222194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3781d64-ea85-4865-a087-82b694c3fbfc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:44.222282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3781d64-ea85-4865-a087-82b694c3fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:44.241200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d3781d64-ea85-4865-a087-82b694c3fbfc None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:12:44.242452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d3781d64-ea85-4865-a087-82b694c3fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:44.303376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1246/2495] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:12:44.349971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:12:44.351428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:12:44.421263 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3185e-06ff-44f7-a2ab-191a4f04781f service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:12:44.426527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8dd50-d072-44b3-87ac-0942e57ec2b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:12:44.427175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8dd50-d072-44b3-87ac-0942e57ec2b7 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:12:44.427457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8dd50-d072-44b3-87ac-0942e57ec2b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:12:44.427731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8dd50-d072-44b3-87ac-0942e57ec2b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:12:44.436410 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8dd50-d072-44b3-87ac-0942e57ec2b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:12:44.438020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8dd50-d072-44b3-87ac-0942e57ec2b7 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:12:44.446199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1250/2496] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:12:54.296623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=25 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:12:54.442913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=64 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:05.002879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45861d7-ee54-4b83-88c5-1a664bf87198 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.003433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45861d7-ee54-4b83-88c5-1a664bf87198 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.003536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45861d7-ee54-4b83-88c5-1a664bf87198 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.005248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1247/2497] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:13:05.011459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905ad63-61af-4921-83f5-971b514caa0c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.012010 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905ad63-61af-4921-83f5-971b514caa0c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.012129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905ad63-61af-4921-83f5-971b514caa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.030654 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d905ad63-61af-4921-83f5-971b514caa0c None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:13:05.031905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d905ad63-61af-4921-83f5-971b514caa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:05.106254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1251/2498] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:13:05.116514 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45861d7-ee54-4b83-88c5-1a664bf87198 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:13:05.118215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c45861d7-ee54-4b83-88c5-1a664bf87198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:05.186359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45861d7-ee54-4b83-88c5-1a664bf87198 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:13:05.189837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bf14e-2458-415a-8d56-51685f0ada7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:13:05.190475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf14e-2458-415a-8d56-51685f0ada7f service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.190762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf14e-2458-415a-8d56-51685f0ada7f service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.191033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf14e-2458-415a-8d56-51685f0ada7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.201277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bf14e-2458-415a-8d56-51685f0ada7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:13:05.202712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bf14e-2458-415a-8d56-51685f0ada7f service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:13:05.213215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1248/2499] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:13:05.279499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4c98-2803-411f-b149-f350c532e9f0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.279888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4c98-2803-411f-b149-f350c532e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.280165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4c98-2803-411f-b149-f350c532e9f0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.281586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1252/2500] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:13:05.287170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632590dd-6aa6-44a9-bee6-4dabf82296ee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.287592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632590dd-6aa6-44a9-bee6-4dabf82296ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.287804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632590dd-6aa6-44a9-bee6-4dabf82296ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.306851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-632590dd-6aa6-44a9-bee6-4dabf82296ee None None] MFA Rules not processed for user `98347f8bc43f46b0aa0d6fb38c162885`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:13:05.308081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-632590dd-6aa6-44a9-bee6-4dabf82296ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:05.314904 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1249/2501] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:13:05.326902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4c98-2803-411f-b149-f350c532e9f0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:13:05.337678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4c98-2803-411f-b149-f350c532e9f0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:13:05.341891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6587839-3045-483e-a276-b3ff0e8900f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:13:05.342524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6587839-3045-483e-a276-b3ff0e8900f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.342806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6587839-3045-483e-a276-b3ff0e8900f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.343081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6587839-3045-483e-a276-b3ff0e8900f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.350079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6587839-3045-483e-a276-b3ff0e8900f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:13:05.351510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6587839-3045-483e-a276-b3ff0e8900f7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:13:05.359725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1253/2502] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:13:05.440478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e8c16-2b2d-4310-baf5-f5dfda4fea93 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.440801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e8c16-2b2d-4310-baf5-f5dfda4fea93 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.441109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e8c16-2b2d-4310-baf5-f5dfda4fea93 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.442513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1250/2503] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 09:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 09:13:05.448005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fba20-7647-4e7b-91c4-63e02d0b550b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.448305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fba20-7647-4e7b-91c4-63e02d0b550b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.448588 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fba20-7647-4e7b-91c4-63e02d0b550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.468882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d20fba20-7647-4e7b-91c4-63e02d0b550b None None] MFA Rules not processed for user `120533a970c74d98af45911ba7e6a375`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:13:05.470084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d20fba20-7647-4e7b-91c4-63e02d0b550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:05.479835 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1254/2504] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:13:05.490396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e8c16-2b2d-4310-baf5-f5dfda4fea93 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:13:05.501691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e8c16-2b2d-4310-baf5-f5dfda4fea93 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:13:05.505340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:13:05.505974 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:05.506255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:05.506528 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:05.517257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:13:05.518743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:13:05.530078 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1251/2505] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:13:14.563479 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287ccf-0f49-4196-911a-402828111e15 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:14.563970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287ccf-0f49-4196-911a-402828111e15 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:14.564177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287ccf-0f49-4196-911a-402828111e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:14.582459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-59287ccf-0f49-4196-911a-402828111e15 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:13:14.583656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-59287ccf-0f49-4196-911a-402828111e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:14.591455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1255/2506] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:13:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:13:14.603195 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:13:14.621639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bee4c6-bde7-41fe-9a80-aca23e758e88 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:13:14.627379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:13:14.628170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:14.628455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:14.628728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:14.639077 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:13:14.640998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:13:14.651224 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1252/2507] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:13:24.577127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=43 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:24.647310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=41 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:43.131022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bbf30-d5f8-44c1-8095-b2ff0c1b6114 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:43.131567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bbf30-d5f8-44c1-8095-b2ff0c1b6114 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:43.131567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bbf30-d5f8-44c1-8095-b2ff0c1b6114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:43.150692 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-605bbf30-d5f8-44c1-8095-b2ff0c1b6114 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:13:43.151917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-605bbf30-d5f8-44c1-8095-b2ff0c1b6114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:43.160427 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1256/2508] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 09:13:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:13:43.173016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:13:43.183819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f856e4-d8b0-4b3d-b177-cd91d2efb70a service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:13:43.189896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:13:43.190536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:43.190812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:43.191081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:43.211662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:13:43.213734 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:13:43.223385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1253/2509] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:13:53.145432 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:53.218902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:13:53.910314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:53.910607 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:53.910889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:53.930225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] MFA Rules not processed for user `544a8ed11787431db393494eefcba2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:13:53.930225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:53.936979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1257/2510] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:13:57.198954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:13:57.202007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:57.220010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5183-8bca-410f-8af6-d252e4227ed3 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:13:57.227152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:13:57.227856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:13:57.228147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:13:57.228556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:13:57.233457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:13:57.246716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:13:57.248545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:13:57.260789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1254/2511] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:01.648766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:01.650196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:01.662386 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0e28d-fef3-4d64-a05e-c22316d1737c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:01.665976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:01.666619 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:01.666902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:01.667180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:01.668956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:01.681535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:01.682983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:01.693779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1258/2512] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:04.847417 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:04.849026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:04.863331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129542b3-3c17-41e5-aed1-be40932eef2e service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:04.868160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:04.868980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:04.869260 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:04.869534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] PATH_INFO: `/v3/users/4a7b71aa00454406ab83a4891a8a719e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:04.870727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7b71aa00454406ab83a4891a8a719e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:04.872782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:04.920986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7b71aa00454406ab83a4891a8a719e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:04.934209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7b71aa00454406ab83a4891a8a719e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:04.942616 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7b71aa00454406ab83a4891a8a719e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:04.943363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7b71aa00454406ab83a4891a8a719e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:04.953533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e2faad44-2a63-4a80-a15a-7cca823cddba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7b71aa00454406ab83a4891a8a719e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:04.961051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1255/2513] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:04 2022] DELETE /identity/v3/users/4a7b71aa00454406ab83a4891a8a719e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:05.151357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.165590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ff2a-8b51-4729-8093-9ee1f30deac2 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.233770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.234846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.235115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.235393 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] PATH_INFO: `/v3/projects/8e442ff861b14d6492a4b27899632a92` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.236651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e442ff861b14d6492a4b27899632a92)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.239022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.291706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e442ff861b14d6492a4b27899632a92', 'request_id': 'req-50744ef2-ed6c-499e-89e9-7a50f98a3995'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:05.297555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e442ff861b14d6492a4b27899632a92', 'request_id': 'req-50744ef2-ed6c-499e-89e9-7a50f98a3995'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:05.306409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e442ff861b14d6492a4b27899632a92', 'request_id': 'req-50744ef2-ed6c-499e-89e9-7a50f98a3995'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:05.318685 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] The token cache is being invalidate because project 8e442ff861b14d6492a4b27899632a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:05.319104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:05.319652 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-50744ef2-ed6c-499e-89e9-7a50f98a3995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:05.321261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1259/2514] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:05 2022] DELETE /identity/v3/projects/8e442ff861b14d6492a4b27899632a92 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:14:05.326425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.326717 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.326999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.346966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:05.348275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:05.415642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1256/2515] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:05.425097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.425696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.426052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.446746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:05.448024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:05.456664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1260/2516] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:05.461350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.471635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22818af9-4dd0-4d64-a168-fe8f284651ba None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.476566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.477288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.477457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.477733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.478473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:14:05.478788 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.480473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.494476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1257/2517] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:14:05.499642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.510012 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618833e-cc64-4954-a65f-e07c88bb0760 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.514864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.515524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.515850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.516131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.517137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.519200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.545567 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1261/2518] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:05 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:05.550382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.561107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db079-7706-442c-b374-8ab5540feb51 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.608906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:05.627057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.627988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.628292 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.628550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.629405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.632064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.664547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1258/2519] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:05 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:05.665769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.678805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc861269-ace3-4025-8a07-d9ff6e7a4189 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.684100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.684781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.685067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.685346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.686073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.687743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.708316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1262/2520] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:05.709805 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.719949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff64d-0b4b-4a68-9ff3-c75899c18e38 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.725550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ebad0-c8cc-42f6-b6f3-9b28dd135655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.726258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebad0-c8cc-42f6-b6f3-9b28dd135655 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.726547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebad0-c8cc-42f6-b6f3-9b28dd135655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.726879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebad0-c8cc-42f6-b6f3-9b28dd135655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.727571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ebad0-c8cc-42f6-b6f3-9b28dd135655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.729370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ebad0-c8cc-42f6-b6f3-9b28dd135655 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.742043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1259/2521] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:05.746688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.757593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78f689-cd8c-43ab-985a-9b77da16443c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:05.766132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:05.767414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.767816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.768164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] PATH_INFO: `/v3/projects/fad3d9f6ce7b4b328a2c8749650312af/users/397341bd148a4fb0bf2ad9dc25ad6377/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.786711 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad3d9f6ce7b4b328a2c8749650312af, user_id=397341bd148a4fb0bf2ad9dc25ad6377, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:05.789895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:05.806784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1263/2522] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:05 2022] PUT /identity/v3/projects/fad3d9f6ce7b4b328a2c8749650312af/users/397341bd148a4fb0bf2ad9dc25ad6377/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:05.819929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:05.820225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:05.820506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:05.853675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] MFA Rules not processed for user `397341bd148a4fb0bf2ad9dc25ad6377`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:05.854882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:05.926043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1260/2523] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:05.937631 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:05.940157 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:05.950382 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:06.023137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063d06d-b7a2-4646-8d07-21b9e77a64e0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:06.028980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006c6e-55c8-48e7-8ddd-3d5c163d76fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:06.029636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006c6e-55c8-48e7-8ddd-3d5c163d76fc service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:06.030016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006c6e-55c8-48e7-8ddd-3d5c163d76fc service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:06.031430 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006c6e-55c8-48e7-8ddd-3d5c163d76fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:06.039125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006c6e-55c8-48e7-8ddd-3d5c163d76fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:06.040792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006c6e-55c8-48e7-8ddd-3d5c163d76fc service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:06.050531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1264/2524] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:15.400246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:15.463930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831ec71-22a9-40e7-ade7-eb5118e71cf5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:15.468414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:15.469289 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:15.469565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:15.469833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] PATH_INFO: `/v3/users/397341bd148a4fb0bf2ad9dc25ad6377` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:15.471022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397341bd148a4fb0bf2ad9dc25ad6377)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:15.472995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:15.518713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397341bd148a4fb0bf2ad9dc25ad6377'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:15.526348 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:15.532814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397341bd148a4fb0bf2ad9dc25ad6377'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:15.540742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397341bd148a4fb0bf2ad9dc25ad6377'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:15.541445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397341bd148a4fb0bf2ad9dc25ad6377'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:15.548624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397341bd148a4fb0bf2ad9dc25ad6377'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:15.554662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1261/2525] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:15 2022] DELETE /identity/v3/users/397341bd148a4fb0bf2ad9dc25ad6377 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:15.559947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:15.560518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:15.560660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:15.578836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:15.580099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:15.638746 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1265/2526] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:15.649413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:15.650812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:15.709045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942f1b-5362-485a-8cbf-3ed41f429156 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:15.712657 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19752fe-9ffe-4537-83ee-0c8ec698289b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:15.713294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19752fe-9ffe-4537-83ee-0c8ec698289b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:15.713573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19752fe-9ffe-4537-83ee-0c8ec698289b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:15.713841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19752fe-9ffe-4537-83ee-0c8ec698289b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:15.723355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19752fe-9ffe-4537-83ee-0c8ec698289b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:15.724838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19752fe-9ffe-4537-83ee-0c8ec698289b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:15.734282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1262/2527] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:16.006630 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.009632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:16.022737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378cd5-7de9-4d26-9be5-5dae06951bb8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.027618 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.028690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.029042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.029318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] PATH_INFO: `/v3/projects/fad3d9f6ce7b4b328a2c8749650312af` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.030523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad3d9f6ce7b4b328a2c8749650312af)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.032519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.081094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad3d9f6ce7b4b328a2c8749650312af', 'request_id': 'req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:16.086561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad3d9f6ce7b4b328a2c8749650312af', 'request_id': 'req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:16.093784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad3d9f6ce7b4b328a2c8749650312af', 'request_id': 'req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:16.105557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] The token cache is being invalidate because project fad3d9f6ce7b4b328a2c8749650312af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:16.105854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:16.106493 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-278e16f5-ced8-40b6-b2f2-1d69d9ca034a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:16.108375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1266/2528] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:16 2022] DELETE /identity/v3/projects/fad3d9f6ce7b4b328a2c8749650312af => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:16.113685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.113973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.114247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.134876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:16.136668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:16.197360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1263/2529] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:16.205482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.205770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.206078 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.227561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:16.228910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:16.236847 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1267/2530] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:16.241085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.251463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96126a-d571-4515-a270-230f1bec8e2a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.256142 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.256802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.257081 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.257351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.258131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:14:16.258437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.260089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.272033 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1264/2531] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:14:16.276561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.286208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f0646-c275-43e4-8d83-4399e4e94b53 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.291468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.292171 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.292455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.292759 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.293461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.295388 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.299820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:16.323110 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1268/2532] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:16 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:16.327429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.337655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f259-e534-448d-b733-a49a9b9c3168 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.393810 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.394478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.394765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.395043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.395738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.397885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.407143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:16.421040 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1265/2533] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:16 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:14:16.425530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.435988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62122db1-cb92-4ae0-9b27-243ea66f7832 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.440584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.441248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.441531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.441805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.442521 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.444174 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.458842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1269/2534] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:14:16.460085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.471025 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d9eb0-38c7-4e8d-b602-241259173528 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.475783 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa2c3b-cd8f-4faf-8dd1-d0212ef45986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.476457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2c3b-cd8f-4faf-8dd1-d0212ef45986 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.477344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2c3b-cd8f-4faf-8dd1-d0212ef45986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.477625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2c3b-cd8f-4faf-8dd1-d0212ef45986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.478345 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa2c3b-cd8f-4faf-8dd1-d0212ef45986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.479968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa2c3b-cd8f-4faf-8dd1-d0212ef45986 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.490168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1266/2535] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:16.494594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.504672 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a692b-3ff6-41fe-b939-b894afd6ca17 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.509383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.510305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.510593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.510873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] PATH_INFO: `/v3/projects/8b045274bbe84d77a312203e2e48f415/users/89486ab76a16423bacae2bd0564ef7f6/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.525966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b045274bbe84d77a312203e2e48f415, user_id=89486ab76a16423bacae2bd0564ef7f6, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.528894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.544837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1270/2536] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:16 2022] PUT /identity/v3/projects/8b045274bbe84d77a312203e2e48f415/users/89486ab76a16423bacae2bd0564ef7f6/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:16.556639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.556931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.557217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.583907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] MFA Rules not processed for user `89486ab76a16423bacae2bd0564ef7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:16.585113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:16.649322 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1267/2537] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:16.660537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:16.662273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:16.735518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8e07-c3a8-44ad-8dbe-0e0fb9694a32 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:16.741255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c1096-4119-4572-aff2-22a7b2ce0739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:16.741930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c1096-4119-4572-aff2-22a7b2ce0739 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:16.742275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c1096-4119-4572-aff2-22a7b2ce0739 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:16.742555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c1096-4119-4572-aff2-22a7b2ce0739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:16.750415 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c1096-4119-4572-aff2-22a7b2ce0739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:16.752042 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c1096-4119-4572-aff2-22a7b2ce0739 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:16.761392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1271/2538] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:16.959927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.024326 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5bf5b-eb2d-4a1b-875e-f3e3f19508f4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.028853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.029726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.030006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.030277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] PATH_INFO: `/v3/users/89486ab76a16423bacae2bd0564ef7f6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.031461 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89486ab76a16423bacae2bd0564ef7f6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.033714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:17.080391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89486ab76a16423bacae2bd0564ef7f6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.092878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89486ab76a16423bacae2bd0564ef7f6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.099693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89486ab76a16423bacae2bd0564ef7f6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.100393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89486ab76a16423bacae2bd0564ef7f6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.102476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:17.109207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89486ab76a16423bacae2bd0564ef7f6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.116148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1268/2539] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:16 2022] DELETE /identity/v3/users/89486ab76a16423bacae2bd0564ef7f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:17.120915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.121203 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.121484 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.138885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:17.139955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:17.198151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1272/2540] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:17.207817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.209187 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:17.266909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00b2a9-70fd-4cab-93e7-d4b3e074464e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.270567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaad59f-3b5d-4565-a48b-0977a24bc45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.271212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad59f-3b5d-4565-a48b-0977a24bc45c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.271491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad59f-3b5d-4565-a48b-0977a24bc45c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.271790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad59f-3b5d-4565-a48b-0977a24bc45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.281302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaad59f-3b5d-4565-a48b-0977a24bc45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.282746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaad59f-3b5d-4565-a48b-0977a24bc45c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:17.293143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1269/2541] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:17.565547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.567029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:17.579208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29646-04df-48f2-bb9c-7b49972cac92 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.583877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.584748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.585036 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.585310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] PATH_INFO: `/v3/projects/8b045274bbe84d77a312203e2e48f415` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.586535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b045274bbe84d77a312203e2e48f415)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.588494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:17.624262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:17.638900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b045274bbe84d77a312203e2e48f415', 'request_id': 'req-44432228-7638-407f-bc44-6bb578f26d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.644461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b045274bbe84d77a312203e2e48f415', 'request_id': 'req-44432228-7638-407f-bc44-6bb578f26d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.652077 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b045274bbe84d77a312203e2e48f415', 'request_id': 'req-44432228-7638-407f-bc44-6bb578f26d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.663665 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] The token cache is being invalidate because project 8b045274bbe84d77a312203e2e48f415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:17.664794 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.665124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44432228-7638-407f-bc44-6bb578f26d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:17.666752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1273/2542] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:17 2022] DELETE /identity/v3/projects/8b045274bbe84d77a312203e2e48f415 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:17.671733 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.672182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.672359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.690312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:17.691530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:17.752066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1270/2543] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:17.760170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.760523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.760946 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.779305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:17.780541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:17.788623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1274/2544] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:17.793437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.802942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ceee9-67ae-4069-8ff1-d294fd0a450c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.808126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.808771 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.809046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.809315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.810056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:14:17.810359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.812005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:17.823523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1271/2545] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:14:17.828063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.837722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bfcca-3295-4420-b160-de6ce45b6c7e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.842395 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.843049 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.843333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.843608 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.844328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.846321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:17.872126 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1275/2546] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:17 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:17.876235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.886176 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c595f-c0a2-4f19-96f8-9a34243d4e91 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.942786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.943378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.943683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.944002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.944683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.946687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:17.968109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1272/2547] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:17 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:14:17.972240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:17.983020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6b302-01b9-4655-8329-3ebaa7683fd7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:17.987678 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:17.988374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:17.988659 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:17.988938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:17.989653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:17.991267 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.002195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1276/2548] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:18.006269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.017037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c58c4-3134-4017-a5ee-b9cde51ff38e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.021672 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361fd2-6030-4386-ad0e-45fb16071f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.022335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361fd2-6030-4386-ad0e-45fb16071f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.022611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361fd2-6030-4386-ad0e-45fb16071f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.022882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361fd2-6030-4386-ad0e-45fb16071f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.024534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361fd2-6030-4386-ad0e-45fb16071f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.026065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361fd2-6030-4386-ad0e-45fb16071f16 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.031929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:18.039059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1273/2549] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:18.043316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.053403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6e7ee-0b4d-4d71-a6b6-63fd33ceb206 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.058064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.058943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.059218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.059491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] PATH_INFO: `/v3/projects/3987195e041641b9aef2ea0e424c1371/users/e9b52239ae2e46039affe57a195f171e/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.073620 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3987195e041641b9aef2ea0e424c1371, user_id=e9b52239ae2e46039affe57a195f171e, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.076318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.089859 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1277/2550] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:18 2022] PUT /identity/v3/projects/3987195e041641b9aef2ea0e424c1371/users/e9b52239ae2e46039affe57a195f171e/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:14:18.100167 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.100456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.100730 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.127030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] MFA Rules not processed for user `e9b52239ae2e46039affe57a195f171e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:18.128268 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:18.192445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1274/2551] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:18.196957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.258122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cdc75-0301-4ff0-a8b8-584bcef8d4f2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.262780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.263437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.263720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.264027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.264707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.266628 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.292446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1278/2552] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:18 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:18.296727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.307502 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcf10e-d6d7-4f60-b67a-7837a15f28d7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.363876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.364560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.364837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.365138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.365836 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.367813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.387623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1275/2553] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:18 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:18.391720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.402647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e328-9623-4924-a81f-187c77582811 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.407308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.408003 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.408284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.408821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.409570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.411181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.422640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1279/2554] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:18.427360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.437602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e67de-ab7c-4326-9b7d-c0929332d2c1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.442359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.443256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.443542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.443851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] PATH_INFO: `/v3/projects/53627dd56eb84168aa08bf3e765ee5ec/users/4690cb4cac75434083f0ac00c23aa979/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.460312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53627dd56eb84168aa08bf3e765ee5ec, user_id=4690cb4cac75434083f0ac00c23aa979, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.463642 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.477510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1276/2555] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:18 2022] PUT /identity/v3/projects/53627dd56eb84168aa08bf3e765ee5ec/users/4690cb4cac75434083f0ac00c23aa979/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:18.481666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.491626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792012-299c-48d3-910b-f17aaf95233f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.526091 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:18.557918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cc792-3b6c-4d36-9420-0eb878f2175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.558602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc792-3b6c-4d36-9420-0eb878f2175d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.558894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc792-3b6c-4d36-9420-0eb878f2175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.559175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc792-3b6c-4d36-9420-0eb878f2175d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.559948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cc792-3b6c-4d36-9420-0eb878f2175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.561575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cc792-3b6c-4d36-9420-0eb878f2175d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.572626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1280/2556] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:18.577108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.588368 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3f18-7f07-4772-80d4-4c2dc1e1cca3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.592995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.593911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.594194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.594479 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] PATH_INFO: `/v3/projects/53627dd56eb84168aa08bf3e765ee5ec/users/4690cb4cac75434083f0ac00c23aa979/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.596478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53627dd56eb84168aa08bf3e765ee5ec, user_id=4690cb4cac75434083f0ac00c23aa979, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.599168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.609452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1277/2557] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:18 2022] PUT /identity/v3/projects/53627dd56eb84168aa08bf3e765ee5ec/users/4690cb4cac75434083f0ac00c23aa979/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:14:18.621524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.621897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.622189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.651616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] MFA Rules not processed for user `4690cb4cac75434083f0ac00c23aa979`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:18.652867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:18.721290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1281/2558] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:18.732325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.734190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:18.780391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:18.793234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba58ba-a5ce-4c24-ab48-ff1d22b69803 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.796908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.797549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.797829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.798103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.807599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.809074 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.818518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1278/2559] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:18.887810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:18.898581 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb1f8-34cd-496f-911b-573138e4837e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:18.902336 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:18.902971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:18.903257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:18.903561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:18.962350 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:18.963923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:18.973506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1282/2560] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:28.814238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:28.969006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=77 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:33.757701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:33.766662 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f3a3b-8c69-45e7-93ca-739aad5f4f0e service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:33.770169 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:33.770807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:33.771092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:33.771363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:33.773168 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:33.834957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:33.837063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7491c9-7905-4019-b8f3-8f61275e7dc4 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:33.846130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1279/2561] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:38.733204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:38.796729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9dc39-ee8d-454b-b09b-9d9209103c41 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:38.801293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:38.802159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:38.802441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:38.802722 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] PATH_INFO: `/v3/users/e9b52239ae2e46039affe57a195f171e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:38.803931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b52239ae2e46039affe57a195f171e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:38.805860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:38.852572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b52239ae2e46039affe57a195f171e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:38.864466 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b52239ae2e46039affe57a195f171e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:38.865182 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b52239ae2e46039affe57a195f171e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:38.873119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b52239ae2e46039affe57a195f171e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:38.882130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b52239ae2e46039affe57a195f171e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:38.889028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1283/2562] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:38 2022] DELETE /identity/v3/users/e9b52239ae2e46039affe57a195f171e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:38.893574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:38.894072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:38.894188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:38.911723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:38.913433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:38.982066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1280/2563] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:38.991575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:38.993535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:39.051799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b99134-0e31-4ba3-861e-a0a271f3732e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:39.056011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:39.056670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:39.056953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:39.057230 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:39.066642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:39.068114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:39.078362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1284/2564] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:39.368701 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:39.370123 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:39.384098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87349df-6457-47f3-a77f-270b8abb0c4a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:39.389390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:39.391204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:39.391991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:39.392455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] PATH_INFO: `/v3/projects/3987195e041641b9aef2ea0e424c1371` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:39.394228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3987195e041641b9aef2ea0e424c1371)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:39.397173 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:39.453497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3987195e041641b9aef2ea0e424c1371', 'request_id': 'req-16c4a10d-fa4e-4451-9d72-3339d08df396'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.460330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3987195e041641b9aef2ea0e424c1371', 'request_id': 'req-16c4a10d-fa4e-4451-9d72-3339d08df396'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.466844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3987195e041641b9aef2ea0e424c1371', 'request_id': 'req-16c4a10d-fa4e-4451-9d72-3339d08df396'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.480336 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] The token cache is being invalidate because project 3987195e041641b9aef2ea0e424c1371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:39.480758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.481812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.483943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1281/2565] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:39 2022] DELETE /identity/v3/projects/3987195e041641b9aef2ea0e424c1371 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:39.488187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:39.500294 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2aa62-5bb2-4c21-bb2e-c257e2f4d2a9 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:39.519856 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:39.562219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:39.563167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:39.563450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:39.563726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] PATH_INFO: `/v3/users/4690cb4cac75434083f0ac00c23aa979` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:39.564972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4690cb4cac75434083f0ac00c23aa979)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:39.566956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:39.619304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4690cb4cac75434083f0ac00c23aa979'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.635566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4690cb4cac75434083f0ac00c23aa979'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.636379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4690cb4cac75434083f0ac00c23aa979'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.644106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4690cb4cac75434083f0ac00c23aa979'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.652904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4011c85b-368b-4c58-9c0f-57fe8f769e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4690cb4cac75434083f0ac00c23aa979'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:39.660517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1285/2566] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:39 2022] DELETE /identity/v3/users/4690cb4cac75434083f0ac00c23aa979 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:39.942882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:39.944503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:39.960580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a10d-fa4e-4451-9d72-3339d08df396 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:39.980794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:40.022837 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.023704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.024020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.024299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] PATH_INFO: `/v3/projects/53627dd56eb84168aa08bf3e765ee5ec` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.025492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53627dd56eb84168aa08bf3e765ee5ec)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.027485 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.074584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53627dd56eb84168aa08bf3e765ee5ec', 'request_id': 'req-e400ce1c-9f9b-4c62-847c-61636a11f274'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:40.079977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53627dd56eb84168aa08bf3e765ee5ec', 'request_id': 'req-e400ce1c-9f9b-4c62-847c-61636a11f274'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:40.086431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53627dd56eb84168aa08bf3e765ee5ec', 'request_id': 'req-e400ce1c-9f9b-4c62-847c-61636a11f274'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:40.099550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] The token cache is being invalidate because project 53627dd56eb84168aa08bf3e765ee5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:40.099985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:40.100608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e400ce1c-9f9b-4c62-847c-61636a11f274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:40.102645 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1282/2567] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:39 2022] DELETE /identity/v3/projects/53627dd56eb84168aa08bf3e765ee5ec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:14:40.107509 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.108013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.108114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.126030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:40.127220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:40.184822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1286/2568] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:40.192517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.192804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.193089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.211398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:40.212641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:40.220554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1283/2569] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:40.224730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.235634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800f1a-b9fa-42f2-8c6c-c3e369e10e44 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.240279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.240936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.241216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.241489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.242770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:14:40.243088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.244749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.256534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1287/2570] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:14:40.260831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.270154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3f21b-edc6-4ee7-a929-cff692153019 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.274910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.275556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.275874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.276154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.276844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.278781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.306428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1284/2571] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:40.310799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.321079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9872c-7802-4ead-a1e3-635dc5ae242c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.346720 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:40.378108 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.378772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.379057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.379333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.380043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.382001 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.401828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1288/2572] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:40.405933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.417086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ca61b-3aa3-401b-93bd-bb925952be00 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.421704 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.422362 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.422644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.422920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.423635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.425296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.435677 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1285/2573] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:40.439473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.449440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b198-c9f8-4fde-86ce-7e3875e9d58c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.453992 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd98878-6140-4caf-bd83-3ac3157ff3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.454642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd98878-6140-4caf-bd83-3ac3157ff3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.454923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd98878-6140-4caf-bd83-3ac3157ff3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.455198 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd98878-6140-4caf-bd83-3ac3157ff3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.455947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd98878-6140-4caf-bd83-3ac3157ff3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.457553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd98878-6140-4caf-bd83-3ac3157ff3d2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.468452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1289/2574] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:40.472516 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.482948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226b32-fdd4-4eb9-b24d-b1663e16c70e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.487596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.488487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.488769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.489043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] PATH_INFO: `/v3/projects/1243fa14e25b49dca5ee590905910412/users/9c59f9cab45e465bb3e9d21ee9eb7345/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.503335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1243fa14e25b49dca5ee590905910412, user_id=9c59f9cab45e465bb3e9d21ee9eb7345, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.506073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.518807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1286/2575] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:40 2022] PUT /identity/v3/projects/1243fa14e25b49dca5ee590905910412/users/9c59f9cab45e465bb3e9d21ee9eb7345/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:40.530568 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.530864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.531148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.557737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] MFA Rules not processed for user `9c59f9cab45e465bb3e9d21ee9eb7345`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:40.558947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:40.625052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1290/2576] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:40.629736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.680413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:40.696164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63014df5-8072-4c38-87af-3e402ae2038e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.701403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.702064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.702340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.702611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.703294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.705273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.739052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1287/2577] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:40.743329 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.754178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac573d-94e7-4257-930b-12efe9aa26ca None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.817838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.818597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.818878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.819159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.820079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.822563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.845854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1291/2578] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:40 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:40.850071 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.861411 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414765c-5f6b-4123-ac25-e3ddea42c5f2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.866233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.867010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.867325 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.867597 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.868357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.869999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.881293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1288/2579] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:40.886585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.897046 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63208d3-f4f3-450b-84b3-12bffebb4d35 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:40.903468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:40.905369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:40.905765 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:40.906072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] PATH_INFO: `/v3/projects/26ce9d2602574482bc1fb73bd402a5f2/users/ec92b10e9f6c4d1b9a8a9a89ed5e0ddc/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:40.925129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce9d2602574482bc1fb73bd402a5f2, user_id=ec92b10e9f6c4d1b9a8a9a89ed5e0ddc, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:40.928213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:40.944806 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1292/2580] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:40 2022] PUT /identity/v3/projects/26ce9d2602574482bc1fb73bd402a5f2/users/ec92b10e9f6c4d1b9a8a9a89ed5e0ddc/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:40.954606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:40.966382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a887f6-4966-4999-9e99-375963e225f4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:41.040457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31620bb4-7bd0-4d27-b710-29d3d9df027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:41.041139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31620bb4-7bd0-4d27-b710-29d3d9df027e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:41.041424 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31620bb4-7bd0-4d27-b710-29d3d9df027e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:41.041699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31620bb4-7bd0-4d27-b710-29d3d9df027e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:41.042426 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31620bb4-7bd0-4d27-b710-29d3d9df027e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:41.044089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31620bb4-7bd0-4d27-b710-29d3d9df027e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:41.054797 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1289/2581] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:41.059162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:41.064994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:41.072185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75b66a-224b-4bf2-a3a4-99611d1ffa92 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:41.077054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:41.077937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:41.078221 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:41.078497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] PATH_INFO: `/v3/projects/26ce9d2602574482bc1fb73bd402a5f2/users/ec92b10e9f6c4d1b9a8a9a89ed5e0ddc/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:41.080496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce9d2602574482bc1fb73bd402a5f2, user_id=ec92b10e9f6c4d1b9a8a9a89ed5e0ddc, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:41.083324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:41.094460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1293/2582] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:41 2022] PUT /identity/v3/projects/26ce9d2602574482bc1fb73bd402a5f2/users/ec92b10e9f6c4d1b9a8a9a89ed5e0ddc/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:41.104831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:41.105152 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:41.105435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:41.132138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] MFA Rules not processed for user `ec92b10e9f6c4d1b9a8a9a89ed5e0ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:41.134070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:41.202373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1290/2583] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:41.214032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:41.215952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:41.272577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feac31-f1aa-4682-b8e5-2756813c8953 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:41.276275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c0591-7359-49ed-af80-31660fc29582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:41.276920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0591-7359-49ed-af80-31660fc29582 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:41.277201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0591-7359-49ed-af80-31660fc29582 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:41.277475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0591-7359-49ed-af80-31660fc29582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:41.286772 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c0591-7359-49ed-af80-31660fc29582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:41.288255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c0591-7359-49ed-af80-31660fc29582 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:41.297934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1294/2584] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:41.372773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:41.382498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68900ab1-19cf-48bc-b9d0-5d055ff91eba None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:41.386776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:41.387442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:41.387728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:41.388037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:41.430316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:41.446601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:41.448110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:41.457041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1291/2585] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:42.809551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:42.810047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:42.810178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:42.830115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] MFA Rules not processed for user `acbec87f607d4e00a2107c572fc68643`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:42.831776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:42.895400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1295/2586] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:42.930587 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:42.940978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08913a4-2ff0-4ffb-91ff-ed19d7391868 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:42.945159 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:42.946833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:42.947430 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:42.947745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:42.950843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:43.053264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:43.055286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:43.067499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1292/2587] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:14:43.873613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:43.874971 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:43.939219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bc578-790e-4e0a-8cad-5573536f8da5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:43.943178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:43.943862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:43.944143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:43.944418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:43.946846 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:43.962259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:43.963719 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5643d-2b9a-4bf0-b535-9cd3b3962f7a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:43.975894 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1296/2588] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:44.211627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:44.274255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd65f2-7e91-4b46-8158-9cb8aa56f697 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:44.278902 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:44.279796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:44.280094 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:44.280372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] PATH_INFO: `/v3/users/9c59f9cab45e465bb3e9d21ee9eb7345` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:44.281561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c59f9cab45e465bb3e9d21ee9eb7345)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:44.283814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:44.342989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c59f9cab45e465bb3e9d21ee9eb7345'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.358503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c59f9cab45e465bb3e9d21ee9eb7345'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.368353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:44.371641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c59f9cab45e465bb3e9d21ee9eb7345'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.372870 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c59f9cab45e465bb3e9d21ee9eb7345'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.380920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c59f9cab45e465bb3e9d21ee9eb7345'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.387978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1293/2589] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:44 2022] DELETE /identity/v3/users/9c59f9cab45e465bb3e9d21ee9eb7345 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:44.392702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:44.392986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:44.393256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:44.410881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:44.412113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:44.444982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:44.473402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1297/2590] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:44.483580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:44.485005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:44.543261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca344f16-75e8-4e0d-b36b-adc4a471322f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:44.546862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:44.547542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:44.547846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:44.548122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:44.558064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:44.559506 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:44.569686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1294/2591] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:44.841309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:44.842844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:44.855863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af74fd-0caf-483a-83b0-168ecde4ad32 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:44.860576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:44.861473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:44.861728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:44.861996 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] PATH_INFO: `/v3/projects/1243fa14e25b49dca5ee590905910412` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:44.863235 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1243fa14e25b49dca5ee590905910412)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:44.865549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:44.914039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1243fa14e25b49dca5ee590905910412', 'request_id': 'req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.920286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1243fa14e25b49dca5ee590905910412', 'request_id': 'req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.927483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1243fa14e25b49dca5ee590905910412', 'request_id': 'req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.938815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] The token cache is being invalidate because project 1243fa14e25b49dca5ee590905910412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:44.939133 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.939821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:44.941361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1298/2592] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:44 2022] DELETE /identity/v3/projects/1243fa14e25b49dca5ee590905910412 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:44.945311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:44.955052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b51e3c-2344-4763-a363-723c117dad84 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.012180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.013067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.013344 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.013620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] PATH_INFO: `/v3/users/ec92b10e9f6c4d1b9a8a9a89ed5e0ddc` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.014815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec92b10e9f6c4d1b9a8a9a89ed5e0ddc)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.016802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.063625 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec92b10e9f6c4d1b9a8a9a89ed5e0ddc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.075455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec92b10e9f6c4d1b9a8a9a89ed5e0ddc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.082377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec92b10e9f6c4d1b9a8a9a89ed5e0ddc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.083088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec92b10e9f6c4d1b9a8a9a89ed5e0ddc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.091946 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cd5c9cc7-6ff2-4007-8c8e-1526b36b5aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec92b10e9f6c4d1b9a8a9a89ed5e0ddc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.098113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1295/2593] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:44 2022] DELETE /identity/v3/users/ec92b10e9f6c4d1b9a8a9a89ed5e0ddc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:45.385517 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.387063 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:45.401650 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1fff-1c17-4ecf-b00d-5422ce0d8202 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.463158 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.464081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.464362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.464695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] PATH_INFO: `/v3/projects/26ce9d2602574482bc1fb73bd402a5f2` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.465945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ce9d2602574482bc1fb73bd402a5f2)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.468047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.513818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ce9d2602574482bc1fb73bd402a5f2', 'request_id': 'req-8c222a06-c670-4ffd-8af3-200dad0b50ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.519422 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ce9d2602574482bc1fb73bd402a5f2', 'request_id': 'req-8c222a06-c670-4ffd-8af3-200dad0b50ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.527407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ce9d2602574482bc1fb73bd402a5f2', 'request_id': 'req-8c222a06-c670-4ffd-8af3-200dad0b50ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.528653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:45.541586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] The token cache is being invalidate because project 26ce9d2602574482bc1fb73bd402a5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:45.541877 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.542511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c222a06-c670-4ffd-8af3-200dad0b50ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:45.544092 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1299/2594] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:45 2022] DELETE /identity/v3/projects/26ce9d2602574482bc1fb73bd402a5f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:45.550035 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.550551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.550649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.568028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:45.569225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:45.574034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:45.631912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1296/2595] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:45.640176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.640470 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.640752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.660544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:45.661742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:45.669980 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1300/2596] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:45.674210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.684670 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeda60-4e8e-41d5-b499-4b03b240728e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.689339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.689994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.690274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.690547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.691266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:14:45.691571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.693223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.705692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1297/2597] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:14:45.709936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.719073 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b685f93-96a0-45fe-9770-90dc6669e4c5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.723701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.724387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.724670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.724948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.725632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.727574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.752967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1301/2598] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:45 2022] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:45.757063 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.767578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468e58-f08c-4e46-834c-4c04e3acc5aa admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.823191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.823896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.824218 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.824498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.825199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.827138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.847387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1298/2599] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:45 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:45.851526 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.861918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4c72-6496-4fb6-bcae-91c399d8ebb0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.866644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.867305 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.867594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.867926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.869178 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.870798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.881341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1302/2600] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:14:45.885983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.896307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e76f-2336-4134-af2f-661571c70dd7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.901092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7b7a-0bf5-4e95-b511-6ca018be81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.901766 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7b7a-0bf5-4e95-b511-6ca018be81b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.902057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7b7a-0bf5-4e95-b511-6ca018be81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.902357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7b7a-0bf5-4e95-b511-6ca018be81b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.903080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7b7a-0bf5-4e95-b511-6ca018be81b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.904758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7b7a-0bf5-4e95-b511-6ca018be81b6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.915160 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1299/2601] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:14:45.919331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:45.929401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e351cf-9389-431a-a8e6-35b100fe3cd0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:45.934485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:45.935356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.935640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.935957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] PATH_INFO: `/v3/projects/b6ce79569da34c1898e290d719495c45/users/8b85b469c5964af18923af634efb86c9/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:45.951055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ce79569da34c1898e290d719495c45, user_id=8b85b469c5964af18923af634efb86c9, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:45.953781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:45.971571 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1303/2602] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:45 2022] PUT /identity/v3/projects/b6ce79569da34c1898e290d719495c45/users/8b85b469c5964af18923af634efb86c9/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:45.983484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:45.983852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:45.984135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.011498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] MFA Rules not processed for user `8b85b469c5964af18923af634efb86c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:46.012741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:46.076749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1300/2603] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:46.081279 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.153166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf1ff-a614-4c83-b774-91c4d8e5c30c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.157886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.158802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.159084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.159357 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.160119 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.162027 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.188828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1304/2604] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:46 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:46.193314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.200862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:46.205157 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d179a3-af65-475a-a0be-ad2b93990b3a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.263859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.264542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.264826 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.265102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.265791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.267752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.288577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1301/2605] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:46 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:46.292838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.303869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c4c1-8bdf-42b1-a7df-6f97af6baa27 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.308834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.309536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.309818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.310093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.310820 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.312480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.323864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1305/2606] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:46.328117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.338910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b1bf-2e3c-4d7c-894f-c55ed44097f6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.343613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.344537 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.344820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.345282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] PATH_INFO: `/v3/projects/23bb6f65222947e7a5e61270a50c4efd/users/7683fcb1a3d1496db00a4f8adcaab992/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.360965 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bb6f65222947e7a5e61270a50c4efd, user_id=7683fcb1a3d1496db00a4f8adcaab992, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.363689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.377725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1302/2607] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:46 2022] PUT /identity/v3/projects/23bb6f65222947e7a5e61270a50c4efd/users/7683fcb1a3d1496db00a4f8adcaab992/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:14:46.381644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.392243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481c8d9-9478-40fb-ac93-4dbfd1efa1a2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.446843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708557f-c37f-4488-aa1b-616840e61dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.447431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708557f-c37f-4488-aa1b-616840e61dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.447713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708557f-c37f-4488-aa1b-616840e61dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.448020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708557f-c37f-4488-aa1b-616840e61dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.448727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708557f-c37f-4488-aa1b-616840e61dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.450321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708557f-c37f-4488-aa1b-616840e61dcc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.455446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:46.460870 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1306/2608] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:46.465093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.475456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5571e9-9ccc-4ab3-9b2f-e7b25afb66ac admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.480131 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.481008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.481286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.481555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] PATH_INFO: `/v3/projects/23bb6f65222947e7a5e61270a50c4efd/users/7683fcb1a3d1496db00a4f8adcaab992/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.483495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bb6f65222947e7a5e61270a50c4efd, user_id=7683fcb1a3d1496db00a4f8adcaab992, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.486208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.496913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1303/2609] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:46 2022] PUT /identity/v3/projects/23bb6f65222947e7a5e61270a50c4efd/users/7683fcb1a3d1496db00a4f8adcaab992/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:46.507020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.507404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.507688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.534632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] MFA Rules not processed for user `7683fcb1a3d1496db00a4f8adcaab992`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:46.535857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:46.602656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1307/2610] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:46.613179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.614918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:46.674735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7a1ce-b0b4-4d0a-a053-8f3872177300 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.678598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.679252 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.679539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.679844 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.690135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.691891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.702361 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1304/2611] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:14:46.747645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:46.749107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:46.760974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896a53f-5ab0-4ed3-85d3-85b3ee71cb0d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:46.764577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:46.765212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:46.765496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:46.765771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:46.821531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:46.822979 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:46.832082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1308/2612] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:51.373050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:51.435066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3605-0fa9-4102-91f2-75de1d437a0f service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:51.439694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:51.440585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:51.440863 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:51.441132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] PATH_INFO: `/v3/users/8b85b469c5964af18923af634efb86c9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:51.442304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b85b469c5964af18923af634efb86c9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:51.444376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:51.445818 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:51.489858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:51.491242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:51.492266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b85b469c5964af18923af634efb86c9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:51.505552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b85b469c5964af18923af634efb86c9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:51.513406 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b85b469c5964af18923af634efb86c9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:51.514133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b85b469c5964af18923af634efb86c9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:51.521641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4d6a90f0-d287-4ecc-bfee-d55fafda9646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b85b469c5964af18923af634efb86c9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:51.527693 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1305/2613] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:51 2022] DELETE /identity/v3/users/8b85b469c5964af18923af634efb86c9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:51.532185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:51.532591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:51.532868 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:51.550339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:51.550697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f0ba-fcd2-486f-8058-947090531415 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:51.551549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:51.589527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:51.600919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:51.601576 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:51.601858 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:51.602130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:51.604490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:51.613380 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1306/2614] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:51.614371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:51.617079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:51.625761 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1309/2615] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:14:51.626079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:51.627598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:51.647719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e60f-fbae-4272-ad81-d0174f1ffcd0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:51.652039 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:51.652692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:51.652976 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:51.653253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:51.662922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:51.664422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:51.675147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1307/2616] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:14:52.048511 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:52.050583 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:52.066323 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d30386-3063-42d6-9753-fc90ab7398bf service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:52.071955 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:52.073514 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:52.073865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:52.074212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] PATH_INFO: `/v3/projects/b6ce79569da34c1898e290d719495c45` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:52.076284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ce79569da34c1898e290d719495c45)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:52.078666 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:52.139819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ce79569da34c1898e290d719495c45', 'request_id': 'req-66fab5da-e49b-44a8-8f63-a7f1393b7341'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.152612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ce79569da34c1898e290d719495c45', 'request_id': 'req-66fab5da-e49b-44a8-8f63-a7f1393b7341'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.165281 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ce79569da34c1898e290d719495c45', 'request_id': 'req-66fab5da-e49b-44a8-8f63-a7f1393b7341'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.179379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] The token cache is being invalidate because project b6ce79569da34c1898e290d719495c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:52.179725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.180369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.183822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1310/2617] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:52 2022] DELETE /identity/v3/projects/b6ce79569da34c1898e290d719495c45 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:52.187738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:52.204969 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd7097-c6a7-458b-88a4-6ee0fb5e0e42 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:52.291853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:52.293048 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:52.293333 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:52.293651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] PATH_INFO: `/v3/users/7683fcb1a3d1496db00a4f8adcaab992` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:52.294967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7683fcb1a3d1496db00a4f8adcaab992)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:52.297009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:52.304564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:52.362455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7683fcb1a3d1496db00a4f8adcaab992'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.376968 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7683fcb1a3d1496db00a4f8adcaab992'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.384553 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7683fcb1a3d1496db00a4f8adcaab992'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.386608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7683fcb1a3d1496db00a4f8adcaab992'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.406915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd0a76d8-1308-47ed-bd4d-3e83fab1931a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7683fcb1a3d1496db00a4f8adcaab992'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.415799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1308/2618] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:14:52 2022] DELETE /identity/v3/users/7683fcb1a3d1496db00a4f8adcaab992 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:52.704451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:52.705927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:52.719166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab5da-e49b-44a8-8f63-a7f1393b7341 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:52.777275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:52.778151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:52.778428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:52.778706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] PATH_INFO: `/v3/projects/23bb6f65222947e7a5e61270a50c4efd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:52.779925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bb6f65222947e7a5e61270a50c4efd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:52.781879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:52.828123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bb6f65222947e7a5e61270a50c4efd', 'request_id': 'req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.833681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bb6f65222947e7a5e61270a50c4efd', 'request_id': 'req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.840742 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bb6f65222947e7a5e61270a50c4efd', 'request_id': 'req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.842587 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:52.854152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] The token cache is being invalidate because project 23bb6f65222947e7a5e61270a50c4efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:14:52.854637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.855429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b53d8587-bd9e-4cd9-851f-f06a7c1faffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:14:52.857072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1311/2619] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:14:52 2022] DELETE /identity/v3/projects/23bb6f65222947e7a5e61270a50c4efd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:52.861997 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:52.862285 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:52.862561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:52.880585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:52.881784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:52.941054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1309/2620] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:52.950132 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:52.950421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:52.950703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:52.968863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:52.970115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:52.978138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1312/2621] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:52.983299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:52.993379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f430-f267-464f-bc3d-2d5f00e54ca9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:52.998773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:52.999440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:52.999721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.000020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.000744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:14:53.001161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.002689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.014732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1310/2622] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:14:53.019191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.029015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f29c8-b6c4-49ba-bca8-1a01ff3abc01 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.033995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.034661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.034947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.035225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.035997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.037957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.068834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1313/2623] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:53.069982 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.080066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b208e0-aea4-4bc9-bbcb-e419a60f59a5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.143419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.144138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.144422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.144702 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.145394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.147351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.174021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1311/2624] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:53.175473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.186611 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc21b3-da4a-41d8-9f4d-c64a49730a60 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.192252 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.193187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.193799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.194489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.195210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.196882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.208095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1314/2625] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:53.212133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.217832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:53.224359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb232-b0ea-4515-ba8c-3b7baae43156 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.230925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ea8be-51df-41c1-ba8e-5ddabab3e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.231590 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea8be-51df-41c1-ba8e-5ddabab3e40d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.231908 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea8be-51df-41c1-ba8e-5ddabab3e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.232184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea8be-51df-41c1-ba8e-5ddabab3e40d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.232911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ea8be-51df-41c1-ba8e-5ddabab3e40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.234525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ea8be-51df-41c1-ba8e-5ddabab3e40d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.244916 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1312/2626] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:53.249248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.259260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fec59-c590-4bdf-ac02-9d2554101780 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.263848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.264769 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.265055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.265326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] PATH_INFO: `/v3/projects/1e3b3925e0ca4167a7347063f9c0f66f/users/3676b1a3964c427fb16c2b6c42b8975d/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.280304 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b3925e0ca4167a7347063f9c0f66f, user_id=3676b1a3964c427fb16c2b6c42b8975d, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.282967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.297590 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1315/2627] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:53 2022] PUT /identity/v3/projects/1e3b3925e0ca4167a7347063f9c0f66f/users/3676b1a3964c427fb16c2b6c42b8975d/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:53.308476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.308860 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.309184 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.335885 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] MFA Rules not processed for user `3676b1a3964c427fb16c2b6c42b8975d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:53.337021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:53.402283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1313/2628] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:53.406735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.468621 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef37e9-e483-4e64-856c-cc0ef04d67b0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.473241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.473904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.474186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.474461 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.475144 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.477330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.507253 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1316/2629] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:53.508104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.520156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f31c3-83ad-41d4-9849-964c2fb5fa37 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.580121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.580801 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.581100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.581364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.582069 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.584079 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.609011 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1314/2630] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:14:53.610123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.621700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667e9f-b4d8-4862-bfb8-cb98ca574c55 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.626921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.627604 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.627904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.628193 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.628957 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.630564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.649428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1317/2631] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:14:53.653568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.665762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f88c-b522-4528-b6b1-61bed103ac69 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.671543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ccbeb-765a-4834-8aa6-2daceba6e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.672254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ccbeb-765a-4834-8aa6-2daceba6e4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.672554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ccbeb-765a-4834-8aa6-2daceba6e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.672901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ccbeb-765a-4834-8aa6-2daceba6e4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.673631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ccbeb-765a-4834-8aa6-2daceba6e4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.675237 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ccbeb-765a-4834-8aa6-2daceba6e4a3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.686655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1315/2632] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:53.690972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.701310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea72432-7d14-4dc8-ada0-09e10e6fcedd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.706266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.707181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.707489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.707784 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] PATH_INFO: `/v3/projects/a59b1fa0161e45c1b64b45ddf03ef52d/users/0fdc645fe25b4d34854ad20b75b0010c/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.722327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59b1fa0161e45c1b64b45ddf03ef52d, user_id=0fdc645fe25b4d34854ad20b75b0010c, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.725045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.738017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1318/2633] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:53 2022] PUT /identity/v3/projects/a59b1fa0161e45c1b64b45ddf03ef52d/users/0fdc645fe25b4d34854ad20b75b0010c/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:14:53.749028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.749316 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.749589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.775283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] MFA Rules not processed for user `0fdc645fe25b4d34854ad20b75b0010c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:53.777013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:53.827072 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:53.845822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1316/2634] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:14:53.850259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.895486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:53.914356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74179cb-626c-4f44-b13e-99bc5cf37d6b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:53.919745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:53.920436 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:53.920721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:53.921002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:53.921701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:53.923646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:53.948595 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1319/2635] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:14:53.952981 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:53.964328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd018a65-6fca-4c84-be36-d5c3dbf78869 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:54.021930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:54.022610 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.022903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.023182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.023897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:54.026374 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:54.047787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1317/2636] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:14:53 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:14:54.050249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:54.060523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c847-4a65-42d5-9077-c00a8c46c706 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:54.065189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:54.065845 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.066131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.066411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.067159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:54.068799 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:54.079246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1320/2637] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:54.083299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:54.093591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097ba07-2041-4dae-a9b5-2a389270c459 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:54.098126 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:54.099000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.099275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.099581 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] PATH_INFO: `/v3/projects/76bd5e8b31b8481b8ce82fac07c7aa7a/users/332ca581feba4fae9548dcb7a9d544b5/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.116027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bd5e8b31b8481b8ce82fac07c7aa7a, user_id=332ca581feba4fae9548dcb7a9d544b5, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:54.118789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:54.131450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1318/2638] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:54 2022] PUT /identity/v3/projects/76bd5e8b31b8481b8ce82fac07c7aa7a/users/332ca581feba4fae9548dcb7a9d544b5/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:54.136062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:54.145616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7348b95-7092-4bbf-8b0b-168fbf9525b6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:54.205680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade03a7-d57e-4acf-bc78-6178d4ca6fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:54.206378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade03a7-d57e-4acf-bc78-6178d4ca6fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.206649 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade03a7-d57e-4acf-bc78-6178d4ca6fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.206925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade03a7-d57e-4acf-bc78-6178d4ca6fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.207660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade03a7-d57e-4acf-bc78-6178d4ca6fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:54.209290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade03a7-d57e-4acf-bc78-6178d4ca6fd7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:54.223397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1321/2639] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:14:54.224327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:54.234669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed93c7-acd6-4eec-b68b-f124c7015c88 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:54.239468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:54.240459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.240740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.241014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] PATH_INFO: `/v3/projects/76bd5e8b31b8481b8ce82fac07c7aa7a/users/332ca581feba4fae9548dcb7a9d544b5/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.242994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bd5e8b31b8481b8ce82fac07c7aa7a, user_id=332ca581feba4fae9548dcb7a9d544b5, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:54.245753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:54.256604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1319/2640] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:14:54 2022] PUT /identity/v3/projects/76bd5e8b31b8481b8ce82fac07c7aa7a/users/332ca581feba4fae9548dcb7a9d544b5/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:14:54.325750 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.326076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.326317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.355495 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] MFA Rules not processed for user `332ca581feba4fae9548dcb7a9d544b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:14:54.357384 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:54.430112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1322/2641] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:14:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:14:54.441674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:14:54.443396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:14:54.499542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423c171-e635-4978-8233-cb9a32add687 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:14:54.503108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:14:54.503740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:14:54.504050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:14:54.504318 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:14:54.559444 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:14:54.561953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:14:54.563776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:14:54.574468 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1320/2642] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:14:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:00.279691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:00.290542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e970-01a3-4aa7-94ba-1010afb1d5ed None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:00.294807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:00.295460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:00.295747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:00.296051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:00.334264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:00.363953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:00.365403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:00.374920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1323/2643] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:00.898695 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:00.907984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba85d-33c5-4beb-8b49-8e2e06dcf3cb service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:00.911914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ed2ad-b9b1-42eb-83fd-e049a0212595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:00.912758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ed2ad-b9b1-42eb-83fd-e049a0212595 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:00.913191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ed2ad-b9b1-42eb-83fd-e049a0212595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:00.913407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ed2ad-b9b1-42eb-83fd-e049a0212595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:00.923269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ed2ad-b9b1-42eb-83fd-e049a0212595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:00.924744 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ed2ad-b9b1-42eb-83fd-e049a0212595 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:00.934188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1321/2644] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:04.791417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:04.872774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c2c8c-119e-4106-8be6-972e98d61dc3 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:04.878130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:04.879028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:04.879300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:04.879510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] PATH_INFO: `/v3/users/3676b1a3964c427fb16c2b6c42b8975d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:04.880753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3676b1a3964c427fb16c2b6c42b8975d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:04.882695 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:04.938827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3676b1a3964c427fb16c2b6c42b8975d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:04.952219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3676b1a3964c427fb16c2b6c42b8975d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:04.952863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3676b1a3964c427fb16c2b6c42b8975d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:04.960421 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3676b1a3964c427fb16c2b6c42b8975d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:04.975531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3676b1a3964c427fb16c2b6c42b8975d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:04.982580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1324/2645] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:15:04 2022] DELETE /identity/v3/users/3676b1a3964c427fb16c2b6c42b8975d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:04.987660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:04.988180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:04.988293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:05.005194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:05.006421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:05.069003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1322/2646] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:05.079401 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:05.080927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:05.141335 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db279a6-b101-428d-98a3-f84376678646 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:05.145069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:05.145712 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:05.146000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:05.146274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:05.155541 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:05.157071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:05.161373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:05.167383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1325/2647] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:05.455266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:05.456724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:05.470732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bccce3-d70e-4aaf-9f87-220c733fe856 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:05.475552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:05.476988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:05.477284 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:05.477745 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] PATH_INFO: `/v3/projects/1e3b3925e0ca4167a7347063f9c0f66f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:05.478967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3b3925e0ca4167a7347063f9c0f66f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:05.481419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:05.529138 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3b3925e0ca4167a7347063f9c0f66f', 'request_id': 'req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.534906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3b3925e0ca4167a7347063f9c0f66f', 'request_id': 'req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.541154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3b3925e0ca4167a7347063f9c0f66f', 'request_id': 'req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.553784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] The token cache is being invalidate because project 1e3b3925e0ca4167a7347063f9c0f66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:15:05.554047 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.554658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.556270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1323/2648] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:15:05 2022] DELETE /identity/v3/projects/1e3b3925e0ca4167a7347063f9c0f66f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:05.560929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:05.570544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3998b3b-dfd0-4a4b-bb10-daf5101a72ca service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:05.626983 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:05.627900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:05.628185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:05.628460 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] PATH_INFO: `/v3/users/0fdc645fe25b4d34854ad20b75b0010c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:05.629683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdc645fe25b4d34854ad20b75b0010c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:05.631731 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:05.677066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdc645fe25b4d34854ad20b75b0010c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.689404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdc645fe25b4d34854ad20b75b0010c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.690072 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdc645fe25b4d34854ad20b75b0010c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.696930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdc645fe25b4d34854ad20b75b0010c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.704237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdc645fe25b4d34854ad20b75b0010c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:05.710351 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1326/2649] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:15:05 2022] DELETE /identity/v3/users/0fdc645fe25b4d34854ad20b75b0010c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:05.985332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:05.988481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:06.018256 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305ddf-1748-4f0d-bef7-ec1771dcfaa7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:06.095272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:06.096226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:06.096510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:06.096787 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] PATH_INFO: `/v3/projects/a59b1fa0161e45c1b64b45ddf03ef52d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:06.098016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59b1fa0161e45c1b64b45ddf03ef52d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:06.100183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:06.110147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:06.172750 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59b1fa0161e45c1b64b45ddf03ef52d', 'request_id': 'req-8b7968f0-401b-434d-89b7-7e289494b248'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.184538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59b1fa0161e45c1b64b45ddf03ef52d', 'request_id': 'req-8b7968f0-401b-434d-89b7-7e289494b248'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.200564 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59b1fa0161e45c1b64b45ddf03ef52d', 'request_id': 'req-8b7968f0-401b-434d-89b7-7e289494b248'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.222371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] The token cache is being invalidate because project a59b1fa0161e45c1b64b45ddf03ef52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:15:06.222817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.223458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.225495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1324/2650] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:15:05 2022] DELETE /identity/v3/projects/a59b1fa0161e45c1b64b45ddf03ef52d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:06.229752 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:06.231137 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:06.246011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcd4fc-5e23-4dcb-9747-8bcf34d6d9cf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:06.309916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:06.310812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:06.311098 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:06.311378 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] PATH_INFO: `/v3/users/332ca581feba4fae9548dcb7a9d544b5` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:06.312629 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332ca581feba4fae9548dcb7a9d544b5)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:06.316991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:06.350045 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:06.378501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332ca581feba4fae9548dcb7a9d544b5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.400266 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332ca581feba4fae9548dcb7a9d544b5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.401017 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332ca581feba4fae9548dcb7a9d544b5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.409790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332ca581feba4fae9548dcb7a9d544b5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.419876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332ca581feba4fae9548dcb7a9d544b5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.425438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:06.427127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:06.428592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1327/2651] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:15:06 2022] DELETE /identity/v3/users/332ca581feba4fae9548dcb7a9d544b5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:15:06.493051 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7968f0-401b-434d-89b7-7e289494b248 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:06.549763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:06.550539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:06.550765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:06.551004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:06.552823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:06.622756 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:06.624295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c075d26-e603-4532-884b-847be167aa42 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:06.637006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1325/2652] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:15:06.720106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:06.722450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:06.806828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1d5b-7703-49eb-afc0-efb858736949 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:06.811548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:06.812459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:06.812745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:06.813032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] PATH_INFO: `/v3/projects/76bd5e8b31b8481b8ce82fac07c7aa7a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:06.814490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bd5e8b31b8481b8ce82fac07c7aa7a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:06.816510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:06.871157 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bd5e8b31b8481b8ce82fac07c7aa7a', 'request_id': 'req-b74cf821-2dff-41bb-b59a-549940404ce2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.878373 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bd5e8b31b8481b8ce82fac07c7aa7a', 'request_id': 'req-b74cf821-2dff-41bb-b59a-549940404ce2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.887748 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bd5e8b31b8481b8ce82fac07c7aa7a', 'request_id': 'req-b74cf821-2dff-41bb-b59a-549940404ce2'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.905245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] The token cache is being invalidate because project 76bd5e8b31b8481b8ce82fac07c7aa7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:15:06.905245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.905245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b74cf821-2dff-41bb-b59a-549940404ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:06.905245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1328/2653] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:15:06 2022] DELETE /identity/v3/projects/76bd5e8b31b8481b8ce82fac07c7aa7a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:06.910429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:06.910726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:06.911005 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:06.918686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:06.932393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:06.934269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:07.010381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1326/2654] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:07.019885 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.020183 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.020473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.040034 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:07.041970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:07.054634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1329/2655] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:07.058922 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.069093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e431-264e-4643-9c81-b71613621d18 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.074605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.075286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.075571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.075882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.076631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:15:07.076940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.078571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.092351 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1327/2656] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:15:07.096805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.106525 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad5c7d-8a32-4552-a363-bb12754c6798 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.111277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.111943 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.112245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.112515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.113194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.115127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.135743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:07.148776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1330/2657] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:15:07 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:15:07.149983 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.161273 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874075-d15f-41cf-ac1b-3bff70807a0a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.219283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.219986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.220272 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.220544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.221735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.223358 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.243676 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1328/2658] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:15:07 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:15:07.247780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.258920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf8620-eeb5-46a9-a2b3-07419efff57a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.265233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.265912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.266194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.267089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.267863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.269824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.291214 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1331/2659] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:15:07.292551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.303423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be68e1-20e1-486e-9ad7-4361957b9043 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.311634 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dbe3d-d60f-44d9-82a4-c9659c56f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.312352 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dbe3d-d60f-44d9-82a4-c9659c56f5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.312636 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dbe3d-d60f-44d9-82a4-c9659c56f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.312915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dbe3d-d60f-44d9-82a4-c9659c56f5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.313649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dbe3d-d60f-44d9-82a4-c9659c56f5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.315370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dbe3d-d60f-44d9-82a4-c9659c56f5e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.328121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1329/2660] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:15:07.332557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.344307 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004eb4-d38e-41d0-b023-89e1ca34e01a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.349365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.350270 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.350551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.350824 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] PATH_INFO: `/v3/projects/631f795e5b9d4d5c827da91bc1a94882/users/ad2fc05d9f18490c96c92f123f40a261/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.371953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f795e5b9d4d5c827da91bc1a94882, user_id=ad2fc05d9f18490c96c92f123f40a261, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.375491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.394481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1332/2661] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:15:07 2022] PUT /identity/v3/projects/631f795e5b9d4d5c827da91bc1a94882/users/ad2fc05d9f18490c96c92f123f40a261/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:07.399403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050822b-63a1-4083-ad02-7368ad4df856 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.399696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050822b-63a1-4083-ad02-7368ad4df856 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.400003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050822b-63a1-4083-ad02-7368ad4df856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.418403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1050822b-63a1-4083-ad02-7368ad4df856 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:07.419605 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1050822b-63a1-4083-ad02-7368ad4df856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:07.480182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1330/2662] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:07.489947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:07.491671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:07.552389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b19e6-cc0f-447b-8a1a-2c1235121fcd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:07.556274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:07.556924 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:07.557211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:07.557505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:07.567472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:07.568956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:07.579897 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1333/2663] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:15:08.255275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:08.256058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:08.256058 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:08.275068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:08.286711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] MFA Rules not processed for user `ad2fc05d9f18490c96c92f123f40a261`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:08.288101 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:08.386429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1331/2664] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:08.397284 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:08.399255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:08.470798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9cc9-0bf4-451d-8f53-59b191cdd084 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:08.474895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:08.475562 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:08.475873 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:08.476151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:08.488228 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:08.489725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:08.500057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1334/2665] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:09.223780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:09.225591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:09.241190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857aaca0-f291-4498-98c4-7081aa650ead None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:09.246760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:09.247654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.247980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.248257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] PATH_INFO: `/v3/users/544a8ed11787431db393494eefcba2e6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.249475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=544a8ed11787431db393494eefcba2e6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:09.251445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:09.301563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544a8ed11787431db393494eefcba2e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.317127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544a8ed11787431db393494eefcba2e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.324658 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544a8ed11787431db393494eefcba2e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.325393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544a8ed11787431db393494eefcba2e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.334447 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2f747d4-908d-40a9-ab69-731bf1d0ae0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544a8ed11787431db393494eefcba2e6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.341567 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1332/2666] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:15:09 2022] DELETE /identity/v3/users/544a8ed11787431db393494eefcba2e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:09.525489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:09.540490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14a57-75e1-4f1a-a962-243ecbadb46a service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:09.604129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:09.605543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.605882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.606107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] PATH_INFO: `/v3/projects/550b6a4abd9342caa18f150846d0277d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.607317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550b6a4abd9342caa18f150846d0277d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:09.609309 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:09.620446 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:09.664290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550b6a4abd9342caa18f150846d0277d', 'request_id': 'req-31a8a477-4a12-454b-827c-16b338609b06'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.670974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550b6a4abd9342caa18f150846d0277d', 'request_id': 'req-31a8a477-4a12-454b-827c-16b338609b06'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.678827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550b6a4abd9342caa18f150846d0277d', 'request_id': 'req-31a8a477-4a12-454b-827c-16b338609b06'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.692246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] The token cache is being invalidate because project 550b6a4abd9342caa18f150846d0277d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:15:09.692499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.693162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-31a8a477-4a12-454b-827c-16b338609b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:15:09.694703 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1335/2667] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:15:09 2022] DELETE /identity/v3/projects/550b6a4abd9342caa18f150846d0277d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:09.699790 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.700085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.700363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.719093 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:09.720371 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:09.784217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1333/2668] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:09.791904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.792888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.793170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.811242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:09.812462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:09.820584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1336/2669] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:09.824726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:09.835080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9df264-4b8a-4e5b-8066-6915ac8761ca None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:09.841200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:09.841947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.842278 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.842584 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.843349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:15:09.843653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:09.845557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbd866-b974-4d15-ad91-f7ca6534df89 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:09.852555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:09.861651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1334/2670] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:15:09.864704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:09.873972 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff8a6a-13a2-4d0f-9634-a307d0d934e3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:09.878600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:09.879244 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.879529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.879836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.880883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:09.882779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:09.888640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.888924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.889204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.908203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] MFA Rules not processed for user `ad2fc05d9f18490c96c92f123f40a261`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:09.909656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:09.910958 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1337/2671] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:15:09 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:15:09.915653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:09.969402 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1335/2672] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:15:09.978634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8ee82-17bc-4301-a783-045242464207 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:09.983074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:09.983768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:09.984060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:09.984338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:09.985033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:09.986989 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:10.011805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1338/2673] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:15:09 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:15:10.014027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:10.025838 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e77dd-055b-4808-9905-9bba5043df04 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:10.031405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:10.032122 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:10.032565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:10.032865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:10.033852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:10.035473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:10.046391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1336/2674] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:15:10.050280 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:10.060566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c27824-91b7-4820-90d6-9f887ddfabd7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:10.065254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de714-bb8e-4879-849d-288a1aa2109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:10.065921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de714-bb8e-4879-849d-288a1aa2109d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:10.066208 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de714-bb8e-4879-849d-288a1aa2109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:10.066501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de714-bb8e-4879-849d-288a1aa2109d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:10.067258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de714-bb8e-4879-849d-288a1aa2109d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:10.068904 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de714-bb8e-4879-849d-288a1aa2109d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:10.080220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1339/2675] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:15:10.084412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:10.095118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7c88a-d244-4883-b43b-6438449215d7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:10.099923 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:10.100812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:10.101180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:10.101367 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] PATH_INFO: `/v3/projects/6589bf32f14e4d86a3ae7ea078aba811/users/111c897ccc2d49c9bd28856dd6b87822/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:10.116819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6589bf32f14e4d86a3ae7ea078aba811, user_id=111c897ccc2d49c9bd28856dd6b87822, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:10.119507 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:10.134026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1337/2676] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:15:10 2022] PUT /identity/v3/projects/6589bf32f14e4d86a3ae7ea078aba811/users/111c897ccc2d49c9bd28856dd6b87822/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:10.139557 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f7cfb-4948-4a83-896f-f378577a5f24 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:10.139882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f7cfb-4948-4a83-896f-f378577a5f24 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:10.140164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f7cfb-4948-4a83-896f-f378577a5f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:10.159558 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1f6f7cfb-4948-4a83-896f-f378577a5f24 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:10.160813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1f6f7cfb-4948-4a83-896f-f378577a5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:10.206189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:10.226320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1340/2677] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:15:10.241107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:10.242961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:10.303848 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d228067-1f37-4e95-bc9b-b5e0fd095456 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:10.307639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:10.308919 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:10.309203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:10.309482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:10.319492 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:10.321006 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:10.331451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1338/2678] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:15:14.756172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:14.756691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:14.756787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:14.801232 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] MFA Rules not processed for user `111c897ccc2d49c9bd28856dd6b87822`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:14.802451 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:14.880165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1341/2679] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:14.884649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:14.895270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369923-bfde-42de-8d19-47b11ff63278 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:14.900266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:14.900944 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:14.901228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:14.902046 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:14.902782 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:14.904809 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:14.938321 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1339/2680] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:15:14 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:15:14.939537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:14.968254 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6f76-f324-49ca-886e-a9ea15f6b9b2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:15.061519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:15.062215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:15.062533 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:15.062929 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:15.063661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:15.065676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:15.087376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1342/2681] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:15:14 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:15:15.091673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:15.108026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f2c08-0e3e-4605-8ef9-b6890727a1c1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:15.112913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:15.113651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:15.113940 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:15.114269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:15.115043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:15.116767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:15.128427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1340/2682] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:15:15.132668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:15.143964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62462-f66d-4037-9fc5-b9dde79d3030 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:15.148822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:15.149724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:15.150009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:15.150287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] PATH_INFO: `/v3/projects/fb5ee0c2db4f4719a2008a6588d4bd58/users/4f4cb5fa21534eeca1c77200dfde897a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:15.167211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5ee0c2db4f4719a2008a6588d4bd58, user_id=4f4cb5fa21534eeca1c77200dfde897a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:15.169974 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:15.183855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1343/2683] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:15:15 2022] PUT /identity/v3/projects/fb5ee0c2db4f4719a2008a6588d4bd58/users/4f4cb5fa21534eeca1c77200dfde897a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:15.187850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:15.198847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9341f4-eca0-4d85-bc15-0e5b2b200dcb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:15.236369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:15.261905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98baab0-6bf3-444b-ad6b-f3a86d43a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:15.262591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baab0-6bf3-444b-ad6b-f3a86d43a345 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:15.262910 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baab0-6bf3-444b-ad6b-f3a86d43a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:15.263141 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baab0-6bf3-444b-ad6b-f3a86d43a345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:15.263913 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98baab0-6bf3-444b-ad6b-f3a86d43a345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:15.265556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98baab0-6bf3-444b-ad6b-f3a86d43a345 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:15.276282 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1341/2684] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:15:15.281029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:15.292219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012fa5-678d-4364-92b0-5e93496ae3bd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:15.296833 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:15.297739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:15.298020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:15.298297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] PATH_INFO: `/v3/projects/fb5ee0c2db4f4719a2008a6588d4bd58/users/4f4cb5fa21534eeca1c77200dfde897a/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:15.300325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5ee0c2db4f4719a2008a6588d4bd58, user_id=4f4cb5fa21534eeca1c77200dfde897a, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:15.303013 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:15.314205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1344/2685] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:15:15 2022] PUT /identity/v3/projects/fb5ee0c2db4f4719a2008a6588d4bd58/users/4f4cb5fa21534eeca1c77200dfde897a/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:15:20.264518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6233e-ec4c-467e-80cd-fb0a40fdebe5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:20.265004 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6233e-ec4c-467e-80cd-fb0a40fdebe5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:20.265183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6233e-ec4c-467e-80cd-fb0a40fdebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:20.294856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ffd6233e-ec4c-467e-80cd-fb0a40fdebe5 None None] MFA Rules not processed for user `4f4cb5fa21534eeca1c77200dfde897a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:20.296056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ffd6233e-ec4c-467e-80cd-fb0a40fdebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:20.372210 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1342/2686] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:20.384745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:20.387005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:20.422118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:20.462106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353876f-c85a-4ccb-b74c-174611df96da admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:20.468021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:20.468775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:20.469613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:20.469613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:20.555288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:20.556888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:20.567006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1345/2687] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:20.675544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d505b-357f-44b8-9d9d-fee6d09e461c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:20.675942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d505b-357f-44b8-9d9d-fee6d09e461c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:20.676388 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d505b-357f-44b8-9d9d-fee6d09e461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:20.695494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-425d505b-357f-44b8-9d9d-fee6d09e461c None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:20.696768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-425d505b-357f-44b8-9d9d-fee6d09e461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:20.781174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1343/2688] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:15:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:20.835135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:20.838239 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:20.914729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568ea3-b496-4baf-b70a-20c8740eb411 service glance] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:20.920107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c6f00-d560-4604-95e6-343632eadfb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:20.920880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6f00-d560-4604-95e6-343632eadfb7 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:20.921188 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6f00-d560-4604-95e6-343632eadfb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:20.921453 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6f00-d560-4604-95e6-343632eadfb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:20.930225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c6f00-d560-4604-95e6-343632eadfb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:20.931874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c6f00-d560-4604-95e6-343632eadfb7 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:20.940986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1346/2689] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:15:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:15:28.047314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:28.047948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:28.047948 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:28.066334 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] MFA Rules not processed for user `ad2fc05d9f18490c96c92f123f40a261`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:28.067572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:28.138009 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1344/2690] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:30.559932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20da5a-3f25-457c-93a5-76f7c83afde3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:30.560563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20da5a-3f25-457c-93a5-76f7c83afde3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:30.560687 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20da5a-3f25-457c-93a5-76f7c83afde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:30.580435 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dc20da5a-3f25-457c-93a5-76f7c83afde3 None None] MFA Rules not processed for user `111c897ccc2d49c9bd28856dd6b87822`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:30.581645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dc20da5a-3f25-457c-93a5-76f7c83afde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:30.589553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1347/2691] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:15:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:31.091630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:31.093842 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:31.105931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:31.194843 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8efd-42f3-4bd4-bef1-ce3cb14b5350 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:31.207724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:31.208445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:31.208732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:31.209012 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:31.210862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:31.323577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:31.325491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:31.347319 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1345/2692] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:15:33.774434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:33.774964 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:33.775067 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:33.795364 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:15:33.796977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:33.819578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1348/2693] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:15:33.838082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:33.856518 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b42cd-a433-4920-a67e-27819df46b67 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:33.865324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:33.866390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:33.866930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:33.867437 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:33.881891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:33.884497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:33.899304 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1346/2694] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:15:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:15:43.789656 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=72 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:43.891330 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=63 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:15:58.839723 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:15:58.841375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:58.898240 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa126dd-7c9b-42b7-be9c-e9cb13ce0f0e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:15:58.901933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:15:58.902580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:15:58.902863 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:15:58.903140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:15:58.904970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:15:58.971325 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:15:58.972743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:15:58.982977 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1349/2695] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:16:02.900722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:02.903109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:02.919881 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7926e-1b28-41f0-8cd1-e0dfeca1111b service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:02.926917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:02.927895 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:02.928193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:02.928473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] PATH_INFO: `/v3/users/22457f943fb84f0794695a132f93a3c3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:02.929765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22457f943fb84f0794695a132f93a3c3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:02.931796 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:02.989749 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22457f943fb84f0794695a132f93a3c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.002699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22457f943fb84f0794695a132f93a3c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.009629 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22457f943fb84f0794695a132f93a3c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.010340 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22457f943fb84f0794695a132f93a3c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.018608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1538d03d-7f3d-4248-9106-e1750ca63955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22457f943fb84f0794695a132f93a3c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.026032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1347/2696] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:16:02 2022] DELETE /identity/v3/users/22457f943fb84f0794695a132f93a3c3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:16:03.216915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.228022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70584e3-89a3-43cc-af43-cefd331bcf3c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.303192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.304115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.304402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.304826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] PATH_INFO: `/v3/projects/fd9b906119034d8ea425a5b768b39e39` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.306079 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9b906119034d8ea425a5b768b39e39)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.308167 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.365694 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9b906119034d8ea425a5b768b39e39', 'request_id': 'req-72fcae20-272b-47af-b0f1-82ba85329c7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.369465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:03.376161 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9b906119034d8ea425a5b768b39e39', 'request_id': 'req-72fcae20-272b-47af-b0f1-82ba85329c7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.389095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9b906119034d8ea425a5b768b39e39', 'request_id': 'req-72fcae20-272b-47af-b0f1-82ba85329c7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.404488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] The token cache is being invalidate because project fd9b906119034d8ea425a5b768b39e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:16:03.404768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.405603 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-72fcae20-272b-47af-b0f1-82ba85329c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:03.408145 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1350/2697] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:16:03 2022] DELETE /identity/v3/projects/fd9b906119034d8ea425a5b768b39e39 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:16:03.412529 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.413022 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.413471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.434728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:03.436117 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:03.503158 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1348/2698] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:16:03.511682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.512074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.512361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.531520 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:03.533026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:03.541148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1351/2699] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:16:03.545223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.554989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4745b8-76cc-4152-89f7-19deee20506c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.560675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.561001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.561307 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.561573 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.562295 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:16:03.562602 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.564257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.581177 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1349/2700] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:16:03.582394 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.592058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ccb1-a7fe-4053-913d-7b0546a8f363 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.597084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.597855 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.598737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.598737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.599257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.601403 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.646816 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1352/2701] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:16:03 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:16:03.648738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.662420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868452ce-f974-4a23-a067-48d99a6a19f9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.733421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.734196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.734600 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.735189 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.735932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.738121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.745703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:03.765763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1350/2702] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:16:03 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:16:03.769478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.781586 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082490e-0629-4a74-bc40-47812503e406 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.786836 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.787592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.788177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.788413 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.789154 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.790839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.802960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1353/2703] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:16:03.808508 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.822789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19384a-9326-4610-9232-4c805d20db18 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.832554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.834314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:03.835473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.836343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.836648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.836937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.838449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.839979 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.859800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1351/2704] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:16:03.862813 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:03.879192 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08324d4-7209-4008-9e8a-03b876877988 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.884207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036577-c0e9-4702-b53c-3c416a8af49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:03.885425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036577-c0e9-4702-b53c-3c416a8af49b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.885850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036577-c0e9-4702-b53c-3c416a8af49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.886690 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036577-c0e9-4702-b53c-3c416a8af49b admin admin] PATH_INFO: `/v3/projects/63847d4652e547aaa4d7be37b0c38c52/users/757aa60ce15f44718b15532550e31a2e/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.905663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1036577-c0e9-4702-b53c-3c416a8af49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63847d4652e547aaa4d7be37b0c38c52, user_id=757aa60ce15f44718b15532550e31a2e, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:03.909275 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1036577-c0e9-4702-b53c-3c416a8af49b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:03.925066 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1352/2705] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:16:03 2022] PUT /identity/v3/projects/63847d4652e547aaa4d7be37b0c38c52/users/757aa60ce15f44718b15532550e31a2e/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:16:03.929817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:03.930114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:03.930442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:03.935912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461491-a300-46fe-899a-017183c6162e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:03.948984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:03.950209 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:04.005699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:04.006360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:04.006644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:04.006923 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:04.008797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:04.016327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1353/2706] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:16:04.021048 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:04.022782 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498f02a-8b79-4bec-8d4e-51bd305d3080 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:04.026052 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:04.027450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:04.034320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1354/2707] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:16:04.086332 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03ad7-e509-43e0-801b-412e9d81f34e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:04.090519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:04.091179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:04.091464 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:04.091735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:04.104255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:04.106382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:04.117619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1354/2708] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:16:08.319636 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faa360-3c7f-4e0c-a97f-a526fc62435d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:08.320200 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faa360-3c7f-4e0c-a97f-a526fc62435d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:08.320287 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faa360-3c7f-4e0c-a97f-a526fc62435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:08.353991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d0faa360-3c7f-4e0c-a97f-a526fc62435d None None] MFA Rules not processed for user `757aa60ce15f44718b15532550e31a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:08.355303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d0faa360-3c7f-4e0c-a97f-a526fc62435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:08.379615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:08.438097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1355/2709] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:16:08.452389 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:08.453934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:08.470841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f5bf-00bc-466b-b410-05c3bcaecf9b service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:08.476598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:08.477266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:08.477552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:08.477834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:08.487239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:08.488898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:08.499648 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1355/2710] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:16:09.652245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902cdfd-4d34-48de-b973-34a60d9d50e8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:09.653053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902cdfd-4d34-48de-b973-34a60d9d50e8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:09.653498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902cdfd-4d34-48de-b973-34a60d9d50e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:09.673276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1902cdfd-4d34-48de-b973-34a60d9d50e8 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:09.674547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1902cdfd-4d34-48de-b973-34a60d9d50e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:09.738283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1356/2711] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 09:16:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:16:09.751669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:09.753372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:09.804656 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:09.832226 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031f54-4d84-44aa-b51f-8f8de3228348 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:09.837754 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:09.838635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:09.839092 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:09.839387 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:09.848927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:09.850884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:09.860313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1356/2712] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:16:10.280370 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:10.280670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:10.281141 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:10.306210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] MFA Rules not processed for user `757aa60ce15f44718b15532550e31a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:10.307878 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:10.315675 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1357/2713] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:16:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:16:10.799995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:10.802194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:10.830739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ffba1-4d46-4a26-804a-b9dc352694c9 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:10.850057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:10.855795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:10.856383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:10.858132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:10.868500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:10.882108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:10.884109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:10.895023 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1357/2714] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:16:11.516821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:11.518854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:11.651729 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636da21-c7a1-4cc0-9f7c-8aa2552cd15f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:11.666565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:11.668283 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:11.668907 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:11.669296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:11.671572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:11.687638 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:11.690324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:11.705258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1358/2715] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:16:20.890483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=18 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:21.699207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=81 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:22.458696 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:22.468300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b66cfa-e4b7-49eb-82f8-ee4089ee96ac service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:22.472104 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:22.473255 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:22.473721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:22.474317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:22.476650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:22.555779 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:22.557905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767e24-f902-4d1d-8140-8c0c3f429ccd service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:22.569390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1358/2716] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:16:25.829103 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:25.855353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673df9d3-7d5e-4b21-a981-204f16254a0d service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:25.861258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:25.861932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:25.862219 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:25.864506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:25.864506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:25.882314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:25.883998 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:25.908828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1359/2717] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:16:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:16:29.751536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:29.752162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:29.752162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:29.769428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:16:29.770620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:29.778630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1359/2718] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 09:16:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:16:29.791346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:29.803724 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc50cc4-ce0a-410c-92b0-ced16ea103b6 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:29.808826 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:29.809480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:29.809766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:29.810050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:29.820938 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:29.822556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:29.831610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1360/2719] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:16:31.800056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:31.801499 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:16:31.816150 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a012c0a-cbfa-4790-8d2a-9bf693abb6a2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:31.820711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:31.821598 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:31.821878 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:31.822155 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] PATH_INFO: `/v3/users/ad2fc05d9f18490c96c92f123f40a261` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:31.824124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2fc05d9f18490c96c92f123f40a261)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:31.825985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:31.881994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2fc05d9f18490c96c92f123f40a261'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:31.894711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2fc05d9f18490c96c92f123f40a261'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:31.902451 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2fc05d9f18490c96c92f123f40a261'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:31.903213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2fc05d9f18490c96c92f123f40a261'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:31.911213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2fc05d9f18490c96c92f123f40a261'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:31.917632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1360/2720] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:16:31 2022] DELETE /identity/v3/users/ad2fc05d9f18490c96c92f123f40a261 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:16:32.098768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:16:32.110615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329eab-5bb3-45a1-8240-c3d04c1bcb65 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:16:32.172887 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:16:32.173760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:16:32.174043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:16:32.174376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] PATH_INFO: `/v3/projects/631f795e5b9d4d5c827da91bc1a94882` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:16:32.175522 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631f795e5b9d4d5c827da91bc1a94882)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:16:32.177480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:16:32.227379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631f795e5b9d4d5c827da91bc1a94882', 'request_id': 'req-961d6af8-bfc3-4d5a-81b9-88cbeac69762'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:32.233411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631f795e5b9d4d5c827da91bc1a94882', 'request_id': 'req-961d6af8-bfc3-4d5a-81b9-88cbeac69762'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:32.241094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631f795e5b9d4d5c827da91bc1a94882', 'request_id': 'req-961d6af8-bfc3-4d5a-81b9-88cbeac69762'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:32.253311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] The token cache is being invalidate because project 631f795e5b9d4d5c827da91bc1a94882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:16:32.253599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:32.254327 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:16:32.255910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1361/2721] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:16:32 2022] DELETE /identity/v3/projects/631f795e5b9d4d5c827da91bc1a94882 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:16:41.913852 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=62,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:16:42.250389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:35.390267 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:35.391711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:35.496740 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd4b64-64ba-4feb-9aae-00763b8871b6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:35.544279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:35.544952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:35.545242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:35.545563 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:35.547364 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:35.626465 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:35.653060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:35.654522 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:35.673989 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1361/2722] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:17:38.726452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:38.728512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:38.906189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6af8-bfc3-4d5a-81b9-88cbeac69762 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:38.912005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:38.912670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:38.912950 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:38.913580 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:38.915821 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:38.929288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:38.930910 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:38.942733 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1362/2723] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:17:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:17:42.111624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:42.123018 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758132-d5e4-49fd-b172-303ae2bf7bc5 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:42.128065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:42.128712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:42.128993 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:42.129266 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:42.131070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:42.143483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:42.145281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:42.156452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1362/2724] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:17:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:17:42.175933 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:42.177434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:42.193797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5fbd1-d3b0-4824-a4db-ad958f7b0032 service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:42.199400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:42.200314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:42.200596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:42.200872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] PATH_INFO: `/v3/users/acbec87f607d4e00a2107c572fc68643` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:42.202085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbec87f607d4e00a2107c572fc68643)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:42.204044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:42.251392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbec87f607d4e00a2107c572fc68643'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.263970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbec87f607d4e00a2107c572fc68643'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.264658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbec87f607d4e00a2107c572fc68643'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.271688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbec87f607d4e00a2107c572fc68643'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.280912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbec87f607d4e00a2107c572fc68643'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.288481 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1363/2725] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:17:42 2022] DELETE /identity/v3/users/acbec87f607d4e00a2107c572fc68643 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:17:42.468814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:42.479781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2798b-a087-4b0c-a863-f942dcde58fb service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:42.537488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:42.538360 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:42.538641 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:42.538912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] PATH_INFO: `/v3/projects/c506ed29f8d94060bb8685604e8f3798` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:42.540118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c506ed29f8d94060bb8685604e8f3798)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:42.542097 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:42.589197 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c506ed29f8d94060bb8685604e8f3798', 'request_id': 'req-e6d78bb1-a19f-4add-8925-a5122ccd8306'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.596064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c506ed29f8d94060bb8685604e8f3798', 'request_id': 'req-e6d78bb1-a19f-4add-8925-a5122ccd8306'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.602853 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c506ed29f8d94060bb8685604e8f3798', 'request_id': 'req-e6d78bb1-a19f-4add-8925-a5122ccd8306'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.615807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] The token cache is being invalidate because project c506ed29f8d94060bb8685604e8f3798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:17:42.616099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.616722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.618281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1363/2726] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:17:42 2022] DELETE /identity/v3/projects/c506ed29f8d94060bb8685604e8f3798 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:17:42.622760 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:42.624216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:42.637770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396ecbe-f110-45d5-af42-2e1baa35d857 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:42.650116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:42.696555 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:42.697433 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:42.698411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:42.698700 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] PATH_INFO: `/v3/users/e5bdac0624594b14b40c8126bad72236` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:42.699953 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5bdac0624594b14b40c8126bad72236)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:42.701902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:42.745976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5bdac0624594b14b40c8126bad72236'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.757775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5bdac0624594b14b40c8126bad72236'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.758447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5bdac0624594b14b40c8126bad72236'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.765976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5bdac0624594b14b40c8126bad72236'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.774582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5bdac0624594b14b40c8126bad72236'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:42.781127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1364/2727] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:17:42 2022] DELETE /identity/v3/users/e5bdac0624594b14b40c8126bad72236 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:17:42.959010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:42.960454 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:42.973474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d78bb1-a19f-4add-8925-a5122ccd8306 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:43.023585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:43.037568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:43.038495 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:43.038711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:43.039000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] PATH_INFO: `/v3/projects/607ecdc5628b4922b7717aca2123f06c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:43.040274 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607ecdc5628b4922b7717aca2123f06c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:43.042721 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:43.089659 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607ecdc5628b4922b7717aca2123f06c', 'request_id': 'req-dbb1b854-092d-45bd-8ddd-288de343bf27'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:43.094977 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607ecdc5628b4922b7717aca2123f06c', 'request_id': 'req-dbb1b854-092d-45bd-8ddd-288de343bf27'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:43.101148 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607ecdc5628b4922b7717aca2123f06c', 'request_id': 'req-dbb1b854-092d-45bd-8ddd-288de343bf27'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:43.114271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] The token cache is being invalidate because project 607ecdc5628b4922b7717aca2123f06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:17:43.114921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:43.115204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-dbb1b854-092d-45bd-8ddd-288de343bf27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:17:43.116807 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1364/2728] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:17:42 2022] DELETE /identity/v3/projects/607ecdc5628b4922b7717aca2123f06c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:17:46.064076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:17:46.065572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:46.136548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915efdb-bed6-4e95-8571-4bc5840fc9a2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:17:46.180948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:46.205097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:17:46.205757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:17:46.206041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:17:46.206314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:17:46.208121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:17:46.219919 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:17:46.221505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:17:46.232780 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1365/2729] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:17:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:17:53.111207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:17:56.227124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=14 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:03.762568 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:18:03.763113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:18:03.763113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:18:03.782201 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] MFA Rules not processed for user `757aa60ce15f44718b15532550e31a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:18:03.783421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:03.839723 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1365/2730] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:18:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:18:04.162888 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:18:04.164367 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:04.220097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d692f9-e29d-420c-93f8-46ce35c62b1c service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:18:04.223809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:18:04.224462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:18:04.224749 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:18:04.225024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:18:04.226810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:04.236862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:18:04.238333 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a13476-7a44-45c1-94be-72e9221fa01c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:18:04.246896 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1366/2731] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:18:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:18:13.832302 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=25 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:14.242920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=26 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:18:57.783105 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:18:57.784752 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:57.899183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd770cd-3d14-4613-bee0-ffd92e48ae05 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:18:57.904951 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:18:57.905622 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:18:57.906182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:18:57.906456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:18:57.908239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:57.920030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:18:57.921609 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:18:57.931890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1366/2732] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:18:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:18:58.823905 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:18:58.824371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:18:58.824473 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:18:58.885399 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] MFA Rules not processed for user `8294ae6c597b4a198312fb562357bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:18:58.887147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:58.952109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1367/2733] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:18:58.997517 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:18:58.998958 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:18:59.088088 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888737b-6d7c-4529-a3f1-519c9bcad557 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:18:59.093683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8b00fb60e5e4548a5371831e56ad76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:18:59.094320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:18:59.094601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:18:59.094873 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:18:59.102777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:18:59.104391 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:18:59.112314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1367/2734] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 09:18:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 09:19:05.569129 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:05.570743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:05.646535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4025d-6ccc-4699-b3ce-2b4202fb8b57 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:05.651118 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:05.652041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:05.652318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:05.652615 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] PATH_INFO: `/v3/users/111c897ccc2d49c9bd28856dd6b87822` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:05.653834 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=111c897ccc2d49c9bd28856dd6b87822)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:05.656115 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:05.702535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111c897ccc2d49c9bd28856dd6b87822'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:05.714705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111c897ccc2d49c9bd28856dd6b87822'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:05.715402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111c897ccc2d49c9bd28856dd6b87822'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:05.716623 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:05.723632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111c897ccc2d49c9bd28856dd6b87822'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:05.731664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111c897ccc2d49c9bd28856dd6b87822'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:05.737599 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1368/2735] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:19:05 2022] DELETE /identity/v3/users/111c897ccc2d49c9bd28856dd6b87822 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:19:05.909835 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:05.921440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e63b6-2e40-4b3c-b61a-0def48456bc7 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:05.956477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:05.989931 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:05.990806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:05.991096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:05.991494 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] PATH_INFO: `/v3/projects/6589bf32f14e4d86a3ae7ea078aba811` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:05.992735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6589bf32f14e4d86a3ae7ea078aba811)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:05.994713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.044269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6589bf32f14e4d86a3ae7ea078aba811', 'request_id': 'req-f41c8305-02fc-4279-9657-0e5a8e7c81b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.049635 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6589bf32f14e4d86a3ae7ea078aba811', 'request_id': 'req-f41c8305-02fc-4279-9657-0e5a8e7c81b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.055628 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6589bf32f14e4d86a3ae7ea078aba811', 'request_id': 'req-f41c8305-02fc-4279-9657-0e5a8e7c81b4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.067519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] The token cache is being invalidate because project 6589bf32f14e4d86a3ae7ea078aba811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:19:06.067828 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.068442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.069942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1368/2736] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:19:05 2022] DELETE /identity/v3/projects/6589bf32f14e4d86a3ae7ea078aba811 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:19:06.073880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.075313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:06.088197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d3d9b-1a92-4cd0-9266-a522a5e6cdfc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.143496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.144459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.144737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.145002 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] PATH_INFO: `/v3/users/4f4cb5fa21534eeca1c77200dfde897a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.146163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4cb5fa21534eeca1c77200dfde897a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.148120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.195960 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4cb5fa21534eeca1c77200dfde897a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.207911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4cb5fa21534eeca1c77200dfde897a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.208593 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4cb5fa21534eeca1c77200dfde897a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.215744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4cb5fa21534eeca1c77200dfde897a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.222597 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1dd8fec1-5eff-40bb-a196-5b130cc1f050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4cb5fa21534eeca1c77200dfde897a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.228789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1369/2737] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:19:06 2022] DELETE /identity/v3/users/4f4cb5fa21534eeca1c77200dfde897a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:19:06.420960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.422438 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:06.435076 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c8305-02fc-4279-9657-0e5a8e7c81b4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.497442 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.498312 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.498591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.498866 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] PATH_INFO: `/v3/projects/fb5ee0c2db4f4719a2008a6588d4bd58` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.500065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5ee0c2db4f4719a2008a6588d4bd58)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.502021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.547404 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5ee0c2db4f4719a2008a6588d4bd58', 'request_id': 'req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.552970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5ee0c2db4f4719a2008a6588d4bd58', 'request_id': 'req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.554820 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:06.559547 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5ee0c2db4f4719a2008a6588d4bd58', 'request_id': 'req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.572133 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] The token cache is being invalidate because project fb5ee0c2db4f4719a2008a6588d4bd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:19:06.572420 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.573044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f060a8fb-8c65-43ca-ab92-3c90d75ea0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:19:06.575114 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1369/2738] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:19:06 2022] DELETE /identity/v3/projects/fb5ee0c2db4f4719a2008a6588d4bd58 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:19:06.580248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.580704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.580811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.635594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:06.636810 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:06.662728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:06.696787 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1370/2739] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:19:06.705172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.705481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.705757 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.724120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:06.725446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:06.733236 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1370/2740] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:19:06.737389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.747680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aa73f-56b0-4036-805f-c85405a1273d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.752316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.753041 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.753353 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.753634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.754361 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:19:06.754671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.756315 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.768594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1371/2741] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:19:06.772688 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.782207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784bf85-477c-49ed-af17-3e0c609089d4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.786846 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.787489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.787791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.788068 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.788753 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.790661 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.819859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1371/2742] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:19:06 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:19:06.822179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.834676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667e914-6282-4eac-99b8-0b470578b7a0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.893375 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.894057 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.894381 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.894661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.895347 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.897504 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.919389 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1372/2743] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:19:06 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:19:06.923413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.934162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52099b8-8050-4c9b-8ba9-ebcc01b36e71 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.938654 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.939308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.939596 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.939914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.940640 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.942248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.953545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1372/2744] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:19:06.957026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:06.967480 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252d1d-dacb-4978-9971-fe87a5e9f8d2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:06.972274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82093-a0f3-4fdd-927f-51f2235719f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:06.972935 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82093-a0f3-4fdd-927f-51f2235719f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:06.973224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82093-a0f3-4fdd-927f-51f2235719f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:06.973501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82093-a0f3-4fdd-927f-51f2235719f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:06.974222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82093-a0f3-4fdd-927f-51f2235719f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:06.975850 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82093-a0f3-4fdd-927f-51f2235719f1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:06.986697 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1373/2745] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:19:06.990557 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:07.000519 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c619-735b-4411-8beb-5b36e19ffc6b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:07.005036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:07.005906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:07.006182 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:07.006450 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] PATH_INFO: `/v3/projects/39196d3b3d514f458e0657ccafaf4134/users/9baba2d9768f4578aeda5f311964229f/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:07.020994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39196d3b3d514f458e0657ccafaf4134, user_id=9baba2d9768f4578aeda5f311964229f, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:07.023725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:07.036925 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1373/2746] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:19:06 2022] PUT /identity/v3/projects/39196d3b3d514f458e0657ccafaf4134/users/9baba2d9768f4578aeda5f311964229f/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:19:07.041848 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93180b-acb7-4054-bd82-834c130cf4db None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:07.042169 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93180b-acb7-4054-bd82-834c130cf4db None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:07.042455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93180b-acb7-4054-bd82-834c130cf4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:07.060606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ac93180b-acb7-4054-bd82-834c130cf4db None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:07.061807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ac93180b-acb7-4054-bd82-834c130cf4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:07.120268 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1374/2747] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:19:07.129611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:07.131283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:07.186999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f739f-af4c-49ce-a234-af098bba4e1b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:07.190572 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:07.191191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:07.191470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:07.191739 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:07.201113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:07.202544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:07.211817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1374/2748] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:19:11.059892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.060743 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.061359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.091234 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] MFA Rules not processed for user `9baba2d9768f4578aeda5f311964229f`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:11.092644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:11.123809 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:11.171380 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1375/2749] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:19:11.176407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:11.186620 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928d30-549d-4015-b32a-278abdecc6c7 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:11.191714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:11.192435 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.192718 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.192995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.193700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:11.196106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:11.227943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1375/2750] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:19:11 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:19:11.230920 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:11.241931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f30b1-ab3b-4762-93e3-c0d86442f817 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:11.314192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:11.314893 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.315218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.315478 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.316256 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:11.318447 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:11.348827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1376/2751] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:19:11 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:19:11.350121 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:11.362193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a7d47-61cd-4995-8b4a-3d53be1ea631 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:11.367106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:11.367961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.368480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.368950 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.369679 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:11.371877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:11.383865 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1376/2752] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:19:11.388570 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:11.401965 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e5a7-e409-4d64-ad8e-e5cac524499e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:11.407226 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:11.408206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.408489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.408770 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] PATH_INFO: `/v3/projects/f12c1963d8fe4970b22c85395be5ca54/users/ba728fee7fa641dbb716072142ffdb45/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.425318 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12c1963d8fe4970b22c85395be5ca54, user_id=ba728fee7fa641dbb716072142ffdb45, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:11.428058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:11.443120 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1377/2753] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:19:11 2022] PUT /identity/v3/projects/f12c1963d8fe4970b22c85395be5ca54/users/ba728fee7fa641dbb716072142ffdb45/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:19:11.447248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:11.457963 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497e9bb-9dad-445d-847c-7687d69267d1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:11.510301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:11.519350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fc963-5e87-4387-8702-5de16938418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:11.520140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fc963-5e87-4387-8702-5de16938418b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.520614 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fc963-5e87-4387-8702-5de16938418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.520894 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fc963-5e87-4387-8702-5de16938418b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.521874 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fc963-5e87-4387-8702-5de16938418b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:11.524030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fc963-5e87-4387-8702-5de16938418b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:11.535057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1377/2754] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:19:11.539296 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:11.549371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5409e-47ad-43dd-9ea3-94e485a0f21d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:11.553984 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:11.554851 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:11.555131 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:11.555408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] PATH_INFO: `/v3/projects/f12c1963d8fe4970b22c85395be5ca54/users/ba728fee7fa641dbb716072142ffdb45/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:11.557372 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12c1963d8fe4970b22c85395be5ca54, user_id=ba728fee7fa641dbb716072142ffdb45, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:11.560658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:11.570596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1378/2755] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:19:11 2022] PUT /identity/v3/projects/f12c1963d8fe4970b22c85395be5ca54/users/ba728fee7fa641dbb716072142ffdb45/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:19:15.904062 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e0dc-78c5-4968-9774-6517e35e1e40 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:15.904545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e0dc-78c5-4968-9774-6517e35e1e40 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:15.904751 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109e0dc-78c5-4968-9774-6517e35e1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:15.941421 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3109e0dc-78c5-4968-9774-6517e35e1e40 None None] MFA Rules not processed for user `ba728fee7fa641dbb716072142ffdb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:15.942633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3109e0dc-78c5-4968-9774-6517e35e1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:16.035129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1378/2756] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:19:16.048705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:16.065085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:16.178487 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d65ec-d948-47b1-98b4-12e697b18a62 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:16.190243 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:16.190945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:16.191225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:16.191574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:16.207248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:16.273547 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:16.275376 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:16.287019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1379/2757] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:19:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:19:17.565889 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:17.566898 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:17.567396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:17.586390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] MFA Rules not processed for user `9baba2d9768f4578aeda5f311964229f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:17.587822 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:17.595163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1379/2758] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:19:26.282735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=20 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:27.580594 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=41 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:43.265512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:43.320869 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65fc1-f066-4bae-9cac-ae935bfe80d2 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:43.324553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:43.325205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:43.325515 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:43.325932 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:43.327683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:43.341210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:43.342660 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:43.353693 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1380/2759] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:19:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:19:44.595802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:44.605480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbd2f3-a5ce-4790-bcd9-0cfb2f698893 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:44.609633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:44.610270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:44.610556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:44.610833 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:44.612615 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:44.625760 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:44.627200 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:44.638577 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1380/2760] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:19:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:19:49.997076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:50.005792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c52527-17ea-479f-b6a5-f7a89d49f346 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:50.009379 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:50.010019 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:50.010300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:50.010574 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:50.012349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:50.021626 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:50.023050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c242-e693-4ac0-bf26-22731b7a4263 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:50.031324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1381/2761] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:19:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:19:54.633257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:19:56.253524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:19:56.263008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3e160-bf4e-4c90-989a-72dcd583c3b0 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:19:56.267188 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:19:56.268143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:56.268592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:56.269089 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:56.281208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:19:56.282935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:19:56.311970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1381/2762] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:19:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:19:59.760047 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343accf-c584-4235-9dda-b34e8db07bf5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:19:59.760617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343accf-c584-4235-9dda-b34e8db07bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:19:59.760617 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343accf-c584-4235-9dda-b34e8db07bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:19:59.777405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2343accf-c584-4235-9dda-b34e8db07bf5 None None] MFA Rules not processed for user `757aa60ce15f44718b15532550e31a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:19:59.778642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2343accf-c584-4235-9dda-b34e8db07bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:19:59.835176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1382/2763] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:20:06.304712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:20:09.827248 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=57 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:27.602561 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:21:27.603962 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:21:27.619683 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd422-92cc-4ceb-a155-bf3aa056c552 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:21:27.626085 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:21:27.626728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:21:27.627016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:21:27.627297 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:21:27.629163 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:21:27.639369 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:21:27.641008 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:21:27.649935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1382/2764] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:21:37.645799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:21:43.635699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:21:43.636224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:21:43.636332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:21:43.654966 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] MFA Rules not processed for user `757aa60ce15f44718b15532550e31a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:21:43.656204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:21:43.663081 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1383/2765] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:21:44.270390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:21:44.271960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:21:44.344995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c523-4c95-4fb1-abe6-b02a803bb326 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:21:44.350129 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:21:44.351128 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:21:44.351415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:21:44.351692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:21:44.353503 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:21:44.365513 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:21:44.367050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:21:44.376998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1383/2766] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:21:51.644258 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:21:51.660180 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0ddc-8d5d-4167-b628-68705316f298 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:21:51.666262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:21:51.666898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:21:51.667179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:21:51.667450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:21:51.669334 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:21:51.682639 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:21:51.684257 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:21:51.695074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1384/2767] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:21:54.372703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=32 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:01.690459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:28.851471 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:22:28.852947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:22:28.865286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8335d-b841-4f88-9ef7-1261187f6981 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:22:28.869808 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:22:28.870535 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:22:28.870832 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:22:28.871112 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:22:28.872967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:22:28.882938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:22:28.884429 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:22:28.893103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1384/2768] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:22:29.989346 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:22:29.998844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78102a-bed1-4fe6-8e05-605db490708d service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:22:30.002644 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:22:30.003398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:22:30.003682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:22:30.003994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:22:30.005775 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:22:30.019069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:22:30.020538 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:22:30.032156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1385/2769] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:22:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:22:38.888859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:40.026572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=6 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:22:50.703338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:22:50.715876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffb96f-050a-4f81-9ea5-28143b615346 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:22:50.720812 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:22:50.721478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:22:50.721763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:22:50.722041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:22:50.723862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:22:50.735238 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:22:50.736851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:22:50.747823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1385/2770] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:22:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:00.743070 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:29.600554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:29.609054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fba5cb-86c5-4684-9e4f-0aa9a7da88fb service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:29.612616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:29.613282 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:29.613559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:29.613827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:29.615565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:29.677653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:29.679101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:29.688560 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1386/2771] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:32.686459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:32.697834 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42a3d-cc95-42f6-8730-270761011658 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:32.702781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:32.703425 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:32.703713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:32.704020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:32.705906 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:32.720016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:32.721943 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:32.733903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1386/2772] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:32.738383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:32.740822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:32.757544 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6b7d-c354-4dfc-8f7e-9073cb2042c5 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:32.762444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:32.763326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:32.763613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:32.763997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] PATH_INFO: `/v3/users/757aa60ce15f44718b15532550e31a2e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:32.765104 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757aa60ce15f44718b15532550e31a2e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:32.767251 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:32.814127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757aa60ce15f44718b15532550e31a2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:32.826321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757aa60ce15f44718b15532550e31a2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:32.827044 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757aa60ce15f44718b15532550e31a2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:32.833812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757aa60ce15f44718b15532550e31a2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:32.842502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-021c94d0-d6eb-4197-b69e-547be33928d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757aa60ce15f44718b15532550e31a2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:32.848308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1387/2773] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:23:32 2022] DELETE /identity/v3/users/757aa60ce15f44718b15532550e31a2e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:33.028960 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.044957 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ea0b-e407-420f-9d09-32b4a23958fb service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.103666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.104639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.104917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.105185 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] PATH_INFO: `/v3/projects/63847d4652e547aaa4d7be37b0c38c52` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.106347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63847d4652e547aaa4d7be37b0c38c52)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.108287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.153973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63847d4652e547aaa4d7be37b0c38c52', 'request_id': 'req-96ec076c-11eb-484c-97f6-0e16532e93b6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:33.159408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63847d4652e547aaa4d7be37b0c38c52', 'request_id': 'req-96ec076c-11eb-484c-97f6-0e16532e93b6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:33.165475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63847d4652e547aaa4d7be37b0c38c52', 'request_id': 'req-96ec076c-11eb-484c-97f6-0e16532e93b6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:33.176639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] The token cache is being invalidate because project 63847d4652e547aaa4d7be37b0c38c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:23:33.176921 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:33.177538 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-96ec076c-11eb-484c-97f6-0e16532e93b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:33.179571 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1387/2774] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:23:33 2022] DELETE /identity/v3/projects/63847d4652e547aaa4d7be37b0c38c52 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:33.184594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.184892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.185199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.203199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:33.204431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:33.262860 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1388/2775] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:33.270872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.271156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.271433 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.289593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:33.290792 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:33.298795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1388/2776] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:33.302829 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.313197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5919c3-2e18-42e9-a556-95c31d5cd4c7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.317876 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.318529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.318814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.319706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.320457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:23:33.320768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.322441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.323874 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:33.336207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1389/2777] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:23:33.340390 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.349621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c663a1-b28d-4ef4-bbb9-44d96ac05193 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.354791 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.355446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.355732 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.356043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.356738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.358649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.393222 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1389/2778] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:23:33.397233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.407206 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f95920-b7de-4e3e-b280-8d364381ef17 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.462771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.463647 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.464011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.464293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.464986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.466937 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.487817 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1390/2779] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:33.492735 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.502956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7891c-052c-44f7-9e83-90bba4da10a8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.507556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.508242 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.508527 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.508804 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.509524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.511132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.520988 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1390/2780] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:33.524913 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.534927 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cf871-dc95-4b5c-bde6-fbda3ce7d96f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.539969 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7dd21-f043-460b-81e2-7ca0e2d9be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.540613 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7dd21-f043-460b-81e2-7ca0e2d9be78 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.540892 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7dd21-f043-460b-81e2-7ca0e2d9be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.541163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7dd21-f043-460b-81e2-7ca0e2d9be78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.541872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7dd21-f043-460b-81e2-7ca0e2d9be78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.543454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7dd21-f043-460b-81e2-7ca0e2d9be78 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.553093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1391/2781] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:33.557560 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.567383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a515fe9-d71d-4790-9bdf-9a5ae9e0de5f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.571999 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.572915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.573146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.573414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] PATH_INFO: `/v3/projects/99dc264a005a4582a1c0ec6e6d68504e/users/c481c48095184dd68958652dbed8d4c9/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.587956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dc264a005a4582a1c0ec6e6d68504e, user_id=c481c48095184dd68958652dbed8d4c9, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.590819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.604083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1391/2782] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:33 2022] PUT /identity/v3/projects/99dc264a005a4582a1c0ec6e6d68504e/users/c481c48095184dd68958652dbed8d4c9/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:33.614064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.614360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.614641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.640987 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] MFA Rules not processed for user `c481c48095184dd68958652dbed8d4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:33.642185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:33.705814 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1392/2783] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:33.710694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.716271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:33.773720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307de77-6c76-408b-88f1-f64ae35b99cb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.778768 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.779487 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.779819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.780107 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.780800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.782816 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.809014 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1392/2784] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:33.813022 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.823839 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4af27-1d4d-4d68-8ce0-e5b22fbcc577 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.879434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.880130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.880418 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.880680 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.881359 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.883354 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.890805 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:33.903181 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1393/2785] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:23:33 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:33.907113 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.917959 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc6a2-a166-427d-9d7b-4d0f2f327230 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.922649 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.923303 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.923588 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.923900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.924619 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.926254 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.936926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1393/2786] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:33.940754 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:33.950637 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31452311-e135-49ae-94ba-c127183b5a48 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:33.955246 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:33.956255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:33.956542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:33.956822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] PATH_INFO: `/v3/projects/0864f5c313ca475fb417d3d0ed024cb2/users/49098dadee214bb19bde5a96ede425e5/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:33.973872 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0864f5c313ca475fb417d3d0ed024cb2, user_id=49098dadee214bb19bde5a96ede425e5, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:33.977260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:33.991060 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1394/2787] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:33 2022] PUT /identity/v3/projects/0864f5c313ca475fb417d3d0ed024cb2/users/49098dadee214bb19bde5a96ede425e5/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:33.994467 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:34.004457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0e7b4-9100-4dca-b38c-53b89b0fbdb9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:34.059961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6395cc-62c5-4968-82f3-7fff8b341e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:34.060617 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6395cc-62c5-4968-82f3-7fff8b341e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:34.060896 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6395cc-62c5-4968-82f3-7fff8b341e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:34.061170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6395cc-62c5-4968-82f3-7fff8b341e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:34.061882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6395cc-62c5-4968-82f3-7fff8b341e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:34.063474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6395cc-62c5-4968-82f3-7fff8b341e70 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:34.073694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1394/2788] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:34.077757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:34.088793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556fa10-8bb1-4676-b180-bcf83aa8a6a3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:34.093683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:34.094612 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:34.094891 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:34.095168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] PATH_INFO: `/v3/projects/0864f5c313ca475fb417d3d0ed024cb2/users/49098dadee214bb19bde5a96ede425e5/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:34.097160 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0864f5c313ca475fb417d3d0ed024cb2, user_id=49098dadee214bb19bde5a96ede425e5, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:34.100068 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:34.110259 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1395/2789] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:34 2022] PUT /identity/v3/projects/0864f5c313ca475fb417d3d0ed024cb2/users/49098dadee214bb19bde5a96ede425e5/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:34.121331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:34.121621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:34.121900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:34.148534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] MFA Rules not processed for user `49098dadee214bb19bde5a96ede425e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:34.149725 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:34.212550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:34.216949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1395/2790] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:34.227374 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:34.229125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:34.309192 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd611cd9-d5e3-4d42-865e-45182d41ada3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:34.312864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:34.313498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:34.313777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:34.314043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:34.323344 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:34.324827 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:34.334116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1396/2791] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:34.405972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:34.415566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb76052-08db-4f41-a053-dcff7b6d8376 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:34.419156 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039ece2-7aef-4b6d-b0f9-6379be33c60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:34.419821 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039ece2-7aef-4b6d-b0f9-6379be33c60c service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:34.420108 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039ece2-7aef-4b6d-b0f9-6379be33c60c service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:34.420385 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039ece2-7aef-4b6d-b0f9-6379be33c60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:34.477225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039ece2-7aef-4b6d-b0f9-6379be33c60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:34.478674 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039ece2-7aef-4b6d-b0f9-6379be33c60c service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:34.487570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1396/2792] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:38.491271 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:38.551864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e533-d796-48ee-9c9e-d40aeaecb908 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:38.556411 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:38.557275 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:38.557554 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:38.557822 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] PATH_INFO: `/v3/users/c481c48095184dd68958652dbed8d4c9` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:38.558990 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c481c48095184dd68958652dbed8d4c9)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:38.560941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:38.601921 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:38.609303 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c481c48095184dd68958652dbed8d4c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:38.621387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c481c48095184dd68958652dbed8d4c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:38.622051 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c481c48095184dd68958652dbed8d4c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:38.628911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c481c48095184dd68958652dbed8d4c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:38.636627 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c481c48095184dd68958652dbed8d4c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:38.642542 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1397/2793] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:23:38 2022] DELETE /identity/v3/users/c481c48095184dd68958652dbed8d4c9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:38.647713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:38.648313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:38.648313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:38.665449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:38.666653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:38.725258 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1397/2794] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:38.734768 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:38.736191 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:38.792676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1d59-7fa2-42f8-9ca4-0a55824e43fd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:38.796300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:38.796941 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:38.797224 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:38.797499 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:38.806313 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:38.807777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:38.817177 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1398/2795] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:39.083309 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:39.084789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:39.096811 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c64a1-4bef-46e2-9704-c4f508aeb9a4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:39.101591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:39.102539 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.102879 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.103225 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] PATH_INFO: `/v3/projects/99dc264a005a4582a1c0ec6e6d68504e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.104544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dc264a005a4582a1c0ec6e6d68504e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:39.106624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:39.154408 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dc264a005a4582a1c0ec6e6d68504e', 'request_id': 'req-36a23b5c-d107-42db-a7cb-e6ec03e519cd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.160251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dc264a005a4582a1c0ec6e6d68504e', 'request_id': 'req-36a23b5c-d107-42db-a7cb-e6ec03e519cd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.166393 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dc264a005a4582a1c0ec6e6d68504e', 'request_id': 'req-36a23b5c-d107-42db-a7cb-e6ec03e519cd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.179054 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] The token cache is being invalidate because project 99dc264a005a4582a1c0ec6e6d68504e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:23:39.179337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.179980 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.181498 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1398/2796] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:23:39 2022] DELETE /identity/v3/projects/99dc264a005a4582a1c0ec6e6d68504e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:39.185428 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:39.195561 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab2f8-3a4b-4841-b075-5f5540733521 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:39.249529 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:39.250450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.250738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.251018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] PATH_INFO: `/v3/users/49098dadee214bb19bde5a96ede425e5` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.252225 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49098dadee214bb19bde5a96ede425e5)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:39.254147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:39.299074 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49098dadee214bb19bde5a96ede425e5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.309818 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:39.312645 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49098dadee214bb19bde5a96ede425e5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.313815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49098dadee214bb19bde5a96ede425e5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.322918 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49098dadee214bb19bde5a96ede425e5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.329789 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-312302bd-24c6-4c1f-9151-7e55972c356d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49098dadee214bb19bde5a96ede425e5'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.335601 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1399/2797] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:23:39 2022] DELETE /identity/v3/users/49098dadee214bb19bde5a96ede425e5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:39.603638 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:39.605124 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:39.618493 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23b5c-d107-42db-a7cb-e6ec03e519cd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:39.644562 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:39.686912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:39.687710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.688026 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.688301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] PATH_INFO: `/v3/projects/0864f5c313ca475fb417d3d0ed024cb2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.689483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0864f5c313ca475fb417d3d0ed024cb2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:39.691419 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:39.737434 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0864f5c313ca475fb417d3d0ed024cb2', 'request_id': 'req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.742824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0864f5c313ca475fb417d3d0ed024cb2', 'request_id': 'req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.748970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0864f5c313ca475fb417d3d0ed024cb2', 'request_id': 'req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.761013 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] The token cache is being invalidate because project 0864f5c313ca475fb417d3d0ed024cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:23:39.761300 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.761938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a86c9cb9-2a7b-4a54-b933-99ee6b4f0ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:39.763431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1399/2798] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:23:39 2022] DELETE /identity/v3/projects/0864f5c313ca475fb417d3d0ed024cb2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:39.768523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.769039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.769152 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.786997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:39.788793 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:39.846596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1400/2799] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:39.854900 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.855199 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.855480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.873545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:39.874928 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:39.883086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1400/2800] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:39.887101 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:39.896564 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e858fc-2193-47f1-8bae-7cbf059dcfa3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:39.901535 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:39.902176 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.902467 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.902986 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.903702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:23:39.904058 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:39.905648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:39.917653 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1401/2801] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:23:39.921711 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:39.930956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942734-455b-48ed-bddf-fa53eb89ee1d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:39.935613 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:39.936301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:39.936585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:39.936862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:39.937593 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:39.939463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:39.968294 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1401/2802] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:23:39 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:39.969293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:39.979734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c8007-218e-4d8c-a263-1c5645ef8a41 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.034179 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.034843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.035124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.035397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.036127 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.038690 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.057658 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1402/2803] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:23:39 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:23:40.061882 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.072884 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e010f-7a00-4709-b33e-63d8b75e5ef1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.077533 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.078191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.078483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.078759 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.079475 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.081111 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.091985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1402/2804] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:40.095797 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.105502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be7d50-1514-41d7-87e2-8042d3754425 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.110006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7078c04-3a53-481d-9192-907cdeba4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.110648 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078c04-3a53-481d-9192-907cdeba4655 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.110928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078c04-3a53-481d-9192-907cdeba4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.111205 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078c04-3a53-481d-9192-907cdeba4655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.111954 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7078c04-3a53-481d-9192-907cdeba4655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.113556 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7078c04-3a53-481d-9192-907cdeba4655 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.123247 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1403/2805] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:40.127248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.137500 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8fb30-64ab-42af-8e11-c3785a50b8c1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.142162 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.143036 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.143320 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.143599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] PATH_INFO: `/v3/projects/476a2078e36d4ffbb3284dcd333fe7fd/users/e61647bf6b904baebd18f6d4b95b3cba/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.158800 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a2078e36d4ffbb3284dcd333fe7fd, user_id=e61647bf6b904baebd18f6d4b95b3cba, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.161543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.174646 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1403/2806] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:40 2022] PUT /identity/v3/projects/476a2078e36d4ffbb3284dcd333fe7fd/users/e61647bf6b904baebd18f6d4b95b3cba/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:40.184689 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.184985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.185269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.212444 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] MFA Rules not processed for user `e61647bf6b904baebd18f6d4b95b3cba`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:40.213577 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:40.245035 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:40.279777 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1404/2807] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:40.284240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.332350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:40.348194 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a2377-cd05-4232-84ff-9aaaec02bde8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.352956 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.353644 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.353927 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.354204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.354912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.356890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.381703 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1404/2808] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:23:40 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:40.385696 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.396443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76a4c-531a-4b1b-925f-1c7e90300c97 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.452572 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.453236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.453518 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.453792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.454477 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.456489 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.476369 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1405/2809] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:23:40 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:23:40.480296 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.490400 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b0e2-20e4-4ea1-af65-9f68ac02940f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.495579 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.496269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.496554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.496831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.497549 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.499149 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.510125 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1405/2810] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:40.514116 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.524032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634c6d-45c7-43b6-b9ee-0557779db38a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.528970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.529838 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.530124 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.530404 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] PATH_INFO: `/v3/projects/c6841944ba38491e8745ebdcb2413140/users/12a43a9be422497fa25fd1ede5d5a54e/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.544776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6841944ba38491e8745ebdcb2413140, user_id=12a43a9be422497fa25fd1ede5d5a54e, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.547455 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.560970 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1406/2811] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:40 2022] PUT /identity/v3/projects/c6841944ba38491e8745ebdcb2413140/users/12a43a9be422497fa25fd1ede5d5a54e/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:40.564795 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.575397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aad229-00d6-4b72-8c76-8b2ebe823c40 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.629764 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c7dee-bc52-4c28-8e8c-9a5f7bc99cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.630410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7dee-bc52-4c28-8e8c-9a5f7bc99cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.630698 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7dee-bc52-4c28-8e8c-9a5f7bc99cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.630972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7dee-bc52-4c28-8e8c-9a5f7bc99cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.632328 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c7dee-bc52-4c28-8e8c-9a5f7bc99cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.634064 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c7dee-bc52-4c28-8e8c-9a5f7bc99cf7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.643489 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1406/2812] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:40.647445 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.657804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f5621-1439-4bcf-aafc-de4ef8005923 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.662360 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.663231 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.663510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.663804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] PATH_INFO: `/v3/projects/c6841944ba38491e8745ebdcb2413140/users/12a43a9be422497fa25fd1ede5d5a54e/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.665744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6841944ba38491e8745ebdcb2413140, user_id=12a43a9be422497fa25fd1ede5d5a54e, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.668414 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.678779 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1407/2813] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:40 2022] PUT /identity/v3/projects/c6841944ba38491e8745ebdcb2413140/users/12a43a9be422497fa25fd1ede5d5a54e/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:40.689694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.690172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.690287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.716536 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] MFA Rules not processed for user `12a43a9be422497fa25fd1ede5d5a54e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:40.717724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:40.784372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1407/2814] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:40.794702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:40.796450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:40.855229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0f29-000f-4d42-905e-6621673e7132 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:40.858900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b658a-d12f-4fc6-a931-53514141786e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:40.859543 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b658a-d12f-4fc6-a931-53514141786e service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:40.859865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b658a-d12f-4fc6-a931-53514141786e service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:40.860139 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b658a-d12f-4fc6-a931-53514141786e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:40.869661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b658a-d12f-4fc6-a931-53514141786e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:40.871099 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b658a-d12f-4fc6-a931-53514141786e service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:40.886634 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1408/2815] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:41.277384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:41.323476 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:41.341204 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a34f-c6e6-4602-ab97-2cba4fdaba73 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:41.345692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:41.346554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:41.346841 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:41.347118 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] PATH_INFO: `/v3/users/e61647bf6b904baebd18f6d4b95b3cba` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:41.348327 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61647bf6b904baebd18f6d4b95b3cba)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:41.350920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:41.394253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61647bf6b904baebd18f6d4b95b3cba'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.406729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61647bf6b904baebd18f6d4b95b3cba'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.414313 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61647bf6b904baebd18f6d4b95b3cba'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.414967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61647bf6b904baebd18f6d4b95b3cba'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.422061 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61647bf6b904baebd18f6d4b95b3cba'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.428341 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1408/2816] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:23:41 2022] DELETE /identity/v3/users/e61647bf6b904baebd18f6d4b95b3cba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:41.432632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:41.432925 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:41.433207 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:41.450828 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:41.452055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:41.480007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:41.517026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1409/2817] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:41.527090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:41.528780 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:41.586095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f274-32b0-46a2-8f65-003bfe7c13d9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:41.589666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:41.590310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:41.590595 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:41.590872 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:41.599743 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:41.601287 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:41.610623 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1409/2818] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:41.876584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:41.878050 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:41.891704 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afabb26-7473-4b6a-9fa2-e4dc3e391b2e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:41.896368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:41.898340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:41.898802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:41.899089 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] PATH_INFO: `/v3/projects/476a2078e36d4ffbb3284dcd333fe7fd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:41.900321 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476a2078e36d4ffbb3284dcd333fe7fd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:41.902276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:41.948277 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476a2078e36d4ffbb3284dcd333fe7fd', 'request_id': 'req-af8d267d-a4b4-4b87-b959-deafc5cedbb9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.953880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476a2078e36d4ffbb3284dcd333fe7fd', 'request_id': 'req-af8d267d-a4b4-4b87-b959-deafc5cedbb9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.960606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476a2078e36d4ffbb3284dcd333fe7fd', 'request_id': 'req-af8d267d-a4b4-4b87-b959-deafc5cedbb9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.971498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] The token cache is being invalidate because project 476a2078e36d4ffbb3284dcd333fe7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:23:41.971807 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.972508 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:41.974237 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1410/2819] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:23:41 2022] DELETE /identity/v3/projects/476a2078e36d4ffbb3284dcd333fe7fd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:41.978257 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:41.988146 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131cf68-0696-43dd-ad7f-8998bd2456f7 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.045098 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.045970 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.046253 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.046530 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] PATH_INFO: `/v3/users/12a43a9be422497fa25fd1ede5d5a54e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.047738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a43a9be422497fa25fd1ede5d5a54e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.049765 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.055565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:42.096324 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a43a9be422497fa25fd1ede5d5a54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.107998 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a43a9be422497fa25fd1ede5d5a54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.114784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a43a9be422497fa25fd1ede5d5a54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.115440 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a43a9be422497fa25fd1ede5d5a54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.127116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-56ae7e0d-0bf1-4302-927c-c2a4dca41e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a43a9be422497fa25fd1ede5d5a54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.136213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1410/2820] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:23:41 2022] DELETE /identity/v3/users/12a43a9be422497fa25fd1ede5d5a54e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:42.408420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.409948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:42.424867 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d267d-a4b4-4b87-b959-deafc5cedbb9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.487130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.488029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.488310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.488582 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] PATH_INFO: `/v3/projects/c6841944ba38491e8745ebdcb2413140` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.489747 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6841944ba38491e8745ebdcb2413140)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.492312 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.539502 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6841944ba38491e8745ebdcb2413140', 'request_id': 'req-fccab838-e85c-4878-bd1e-9b2be79c7990'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.543365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:42.546000 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6841944ba38491e8745ebdcb2413140', 'request_id': 'req-fccab838-e85c-4878-bd1e-9b2be79c7990'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.554737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6841944ba38491e8745ebdcb2413140', 'request_id': 'req-fccab838-e85c-4878-bd1e-9b2be79c7990'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.565862 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] The token cache is being invalidate because project c6841944ba38491e8745ebdcb2413140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:23:42.566156 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.566898 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fccab838-e85c-4878-bd1e-9b2be79c7990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:23:42.568457 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1411/2821] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:23:42 2022] DELETE /identity/v3/projects/c6841944ba38491e8745ebdcb2413140 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:23:42.573384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.573675 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.573954 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.591343 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:42.592580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:42.651784 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1411/2822] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:42.659735 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.660055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.660332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.679163 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:42.680390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:42.688210 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1412/2823] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:42.692196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.701886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c9fa-d621-44c7-b051-f70f27f82a6b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.706474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.707127 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.707410 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.707686 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.708446 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:23:42.708758 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.710851 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.722678 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1412/2824] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:23:42.727464 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.736725 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28db382-e9c5-41ca-9223-3de970ffddfe None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.741320 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.741963 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.742249 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.742524 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.743197 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.745458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.771458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1413/2825] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:23:42 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:42.776687 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.788637 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c845bf5-8f53-4320-a7d7-aaeee1312007 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.847576 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.848347 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.848633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.848912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.849608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.852211 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.871720 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1413/2826] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:23:42 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:23:42.876533 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.887028 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8415cc-5d4e-4a92-a6e6-3d2f089d06f0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.891698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.892440 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.892718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.892991 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.893702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.895348 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.906448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1414/2827] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:42.910301 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.916154 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:42.922543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832fe5-a19d-4e2f-bc0b-cb1ea5215e70 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.927978 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5b826-3596-41dd-a8df-98b99f137ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.928630 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b826-3596-41dd-a8df-98b99f137ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.928914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b826-3596-41dd-a8df-98b99f137ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.929191 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b826-3596-41dd-a8df-98b99f137ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.929915 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5b826-3596-41dd-a8df-98b99f137ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.931523 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5b826-3596-41dd-a8df-98b99f137ec7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.941381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1414/2828] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:23:42.945349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:42.955409 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e050a2c-4cb4-4e58-882c-5c8c3604e97e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:42.960642 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:42.961519 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:42.961802 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:42.962080 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] PATH_INFO: `/v3/projects/cad7eaead6314b7fae4785776f41bc66/users/58be909eea694453a1c22d2dc27fe32a/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:42.977308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad7eaead6314b7fae4785776f41bc66, user_id=58be909eea694453a1c22d2dc27fe32a, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:42.980026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:42.993095 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1415/2829] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:23:42 2022] PUT /identity/v3/projects/cad7eaead6314b7fae4785776f41bc66/users/58be909eea694453a1c22d2dc27fe32a/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:23:43.004293 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:43.004719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:43.004850 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:43.031339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] MFA Rules not processed for user `58be909eea694453a1c22d2dc27fe32a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:23:43.032574 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:43.097497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1415/2830] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:23:43.109054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:23:43.110766 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:23:43.167355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6f6c-f5ab-417b-808f-d23cb8d3cd9c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:23:43.170982 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71423371-96c9-411a-baec-29eec95a63be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:23:43.171624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423371-96c9-411a-baec-29eec95a63be service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:23:43.171948 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423371-96c9-411a-baec-29eec95a63be service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:23:43.172242 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423371-96c9-411a-baec-29eec95a63be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:23:43.180559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71423371-96c9-411a-baec-29eec95a63be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:23:43.182006 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71423371-96c9-411a-baec-29eec95a63be service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:23:43.190755 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1416/2831] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:23:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:23:53.094003 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=36 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:23:53.186843 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:04.782202 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:04.843726 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5151be7-cdec-4942-b309-94b69909a7ee None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:04.848269 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:04.849139 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:04.849422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:04.849700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] PATH_INFO: `/v3/users/58be909eea694453a1c22d2dc27fe32a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:04.851373 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58be909eea694453a1c22d2dc27fe32a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:04.853365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:04.898926 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58be909eea694453a1c22d2dc27fe32a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:04.911082 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58be909eea694453a1c22d2dc27fe32a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:04.918331 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58be909eea694453a1c22d2dc27fe32a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:04.918973 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58be909eea694453a1c22d2dc27fe32a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:04.926279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58be909eea694453a1c22d2dc27fe32a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:04.932778 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1416/2832] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:04 2022] DELETE /identity/v3/users/58be909eea694453a1c22d2dc27fe32a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:04.937186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:04.937688 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:04.937798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:04.954276 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:04.955494 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:05.015322 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1417/2833] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:05.025002 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.026413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:05.083653 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b2fb-e75c-4551-a6dc-25d229038106 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.087350 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eefac-dcdb-41e6-90a4-4aa13e1b05ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.088024 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eefac-dcdb-41e6-90a4-4aa13e1b05ba service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.088311 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eefac-dcdb-41e6-90a4-4aa13e1b05ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.088589 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eefac-dcdb-41e6-90a4-4aa13e1b05ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.097555 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eefac-dcdb-41e6-90a4-4aa13e1b05ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.098991 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eefac-dcdb-41e6-90a4-4aa13e1b05ba service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.109288 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1417/2834] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:05.380947 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.382448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:05.395339 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb282d-aaa9-445c-822f-d996f530be36 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.400553 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.401419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.401705 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.401976 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] PATH_INFO: `/v3/projects/cad7eaead6314b7fae4785776f41bc66` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.408527 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad7eaead6314b7fae4785776f41bc66)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.410491 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.456398 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad7eaead6314b7fae4785776f41bc66', 'request_id': 'req-0e36f070-ccbf-4d6c-868b-ebb618b199ed'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:05.462213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad7eaead6314b7fae4785776f41bc66', 'request_id': 'req-0e36f070-ccbf-4d6c-868b-ebb618b199ed'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:05.470138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad7eaead6314b7fae4785776f41bc66', 'request_id': 'req-0e36f070-ccbf-4d6c-868b-ebb618b199ed'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:05.481592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] The token cache is being invalidate because project cad7eaead6314b7fae4785776f41bc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:05.481940 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:05.482585 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0e36f070-ccbf-4d6c-868b-ebb618b199ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:05.484151 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1418/2835] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:05 2022] DELETE /identity/v3/projects/cad7eaead6314b7fae4785776f41bc66 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:05.489043 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.489339 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.489651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.506829 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:05.508080 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:05.525183 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:05.571869 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1418/2836] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:05.579536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.579879 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.580166 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.598706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:05.599936 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:05.607744 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1419/2837] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:05.611891 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.621413 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96233cf6-34e9-4f91-9eb6-b826b8ba7e45 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.625985 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.626624 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.626905 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.627178 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.627952 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:24:05.628261 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.629914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.641747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1419/2838] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:24:05.645781 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.655734 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a30f-28ac-4b85-9d8c-a6df7e3adab0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.660368 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.661009 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.661289 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.661563 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.662245 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.664201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.689185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1420/2839] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:24:05 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:24:05.693234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.703556 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab2ec-994c-42b0-9c43-534c7af9f518 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.762248 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.762930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.763217 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.763497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.764246 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.766193 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.786639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1420/2840] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:24:05 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:24:05.790715 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.800882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c5ab9-cf82-4dcd-ab2f-0a977f6f5d6a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.805419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.806064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.806349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.806624 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.807338 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.809024 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.820011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1421/2841] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:05.823694 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.833876 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1883d-bcff-471f-b0ae-dba584e665d0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.839299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd00c9-ed2a-4f3e-b73d-5447b62b9214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.840001 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd00c9-ed2a-4f3e-b73d-5447b62b9214 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.840317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd00c9-ed2a-4f3e-b73d-5447b62b9214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.840666 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd00c9-ed2a-4f3e-b73d-5447b62b9214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.842045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd00c9-ed2a-4f3e-b73d-5447b62b9214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.844545 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd00c9-ed2a-4f3e-b73d-5447b62b9214 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.856190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1421/2842] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 09:24:05.860291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:05.870186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebae8-a986-4a19-b430-71af6f3ddba0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:05.874762 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:05.875683 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.876054 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.876340 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] PATH_INFO: `/v3/projects/70a746b00fb44538b63f5fee53ff1c78/users/5e1d2c3075d8422497fa4b3e9f9a5b7c/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.891465 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a746b00fb44538b63f5fee53ff1c78, user_id=5e1d2c3075d8422497fa4b3e9f9a5b7c, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:05.894189 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:05.907605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1422/2843] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:24:05 2022] PUT /identity/v3/projects/70a746b00fb44538b63f5fee53ff1c78/users/5e1d2c3075d8422497fa4b3e9f9a5b7c/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:05.917888 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:05.918181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:05.918459 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:05.945542 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] MFA Rules not processed for user `5e1d2c3075d8422497fa4b3e9f9a5b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:05.946763 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:06.010580 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1422/2844] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:24:06.015066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.036062 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:06.078295 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4899a1-9595-43ca-833c-059cdb3944bb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.083076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.083730 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.084052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.084330 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.085033 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.086956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.110967 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1423/2845] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:24:06 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:24:06.115020 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.126102 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40e45-5c7d-45b1-adf2-1e81b54ece78 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.138918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:06.188412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.189096 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.189379 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.189806 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.190496 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.192504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.211448 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1423/2846] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:24:06 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:24:06.215362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.225676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f4c2-ddec-431b-a45f-ffaf944f73f4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.230594 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.231260 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.231548 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.231864 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.232592 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.234204 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.245229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1424/2847] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:06.248819 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.259423 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0f25-8e1d-4c4b-8808-86ade1a4ac5a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.264472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c268-7fe3-4c90-be12-df1327e3627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.265065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c268-7fe3-4c90-be12-df1327e3627f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.265349 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c268-7fe3-4c90-be12-df1327e3627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.265626 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c268-7fe3-4c90-be12-df1327e3627f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.266525 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c268-7fe3-4c90-be12-df1327e3627f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.268180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c268-7fe3-4c90-be12-df1327e3627f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.278463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1424/2848] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:06.282501 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.293172 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0dea0-16bc-4d5a-ab32-cf7ed9243518 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.297811 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.298681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.298959 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.299241 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] PATH_INFO: `/v3/projects/373d9ba677914f848d4fe3f28e09b39f/users/465d449afb054d47b802e8335cd88d6c/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.314371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] RBAC: Authorizing `identity:create_grant(project_id=373d9ba677914f848d4fe3f28e09b39f, user_id=465d449afb054d47b802e8335cd88d6c, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.317112 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.330029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1425/2849] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:24:06 2022] PUT /identity/v3/projects/373d9ba677914f848d4fe3f28e09b39f/users/465d449afb054d47b802e8335cd88d6c/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:06.340972 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.341270 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.341551 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.368161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] MFA Rules not processed for user `465d449afb054d47b802e8335cd88d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:06.369372 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:06.440747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1425/2850] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:06.445985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.507383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8387b1f-365a-47d9-bd87-025a78e1417a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.512159 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.512819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.513109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.513383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.514071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.516086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.541004 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1426/2851] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:24:06 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:24:06.545100 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.556445 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d76f0-e73d-45be-98ca-93a4d6478d59 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.611428 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.612116 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.612399 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.612673 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.613381 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.615376 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.635247 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1426/2852] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:24:06 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:24:06.639105 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.649498 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2decd3-3d95-4c12-8ccd-d1588cb7cd7f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.654505 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.655164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.655450 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.655728 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.656485 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.658084 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.668995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1427/2853] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:06.672699 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.683032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b48ac-5198-4388-bbdb-8dcd2ad40d43 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.687578 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.688488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.688767 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.689044 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] PATH_INFO: `/v3/projects/0dce9416276a4790a4105ca553791699/users/7c49d247e0484076a52e1e8cfdae79cb/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.701550 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:06.704762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dce9416276a4790a4105ca553791699, user_id=7c49d247e0484076a52e1e8cfdae79cb, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.708045 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.721552 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1427/2854] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:24:06 2022] PUT /identity/v3/projects/0dce9416276a4790a4105ca553791699/users/7c49d247e0484076a52e1e8cfdae79cb/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:06.726052 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.736153 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecdadc-77ba-4505-9f66-28c7776aaf64 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.777676 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:06.794255 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4b5ff-ab72-4746-be03-dd28f2ed5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.794917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b5ff-ab72-4746-be03-dd28f2ed5797 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.795199 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b5ff-ab72-4746-be03-dd28f2ed5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.795475 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4b5ff-ab72-4746-be03-dd28f2ed5797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.796223 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4b5ff-ab72-4746-be03-dd28f2ed5797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.797813 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4b5ff-ab72-4746-be03-dd28f2ed5797 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.807314 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1428/2855] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:06.811415 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.821712 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d84d0b-cea1-4323-8379-2f39de5dc63f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:06.826263 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:06.827140 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.827422 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.827697 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] PATH_INFO: `/v3/projects/0dce9416276a4790a4105ca553791699/users/7c49d247e0484076a52e1e8cfdae79cb/roles/b88322e1806b4d37b60ebeb7b136d88c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.829700 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dce9416276a4790a4105ca553791699, user_id=7c49d247e0484076a52e1e8cfdae79cb, role_id=b88322e1806b4d37b60ebeb7b136d88c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:06.832412 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:06.842802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1428/2856] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:24:06 2022] PUT /identity/v3/projects/0dce9416276a4790a4105ca553791699/users/7c49d247e0484076a52e1e8cfdae79cb/roles/b88322e1806b4d37b60ebeb7b136d88c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:06.853342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:06.853632 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:06.853909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:06.880668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] MFA Rules not processed for user `7c49d247e0484076a52e1e8cfdae79cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:06.881912 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:06.949758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1429/2857] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:24:06.961359 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:06.963086 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:07.019911 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215fa9-6e3c-4776-a3e5-4571d58e62f1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:07.024115 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:07.024746 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:07.025031 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:07.025308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:07.081027 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:07.082484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:07.091897 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1429/2858] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:08.557086 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:08.558486 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:08.570670 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62373cd2-c2ac-4dab-b14e-baadab4de889 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:08.574147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:08.574776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:08.575055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:08.575326 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:08.629909 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:08.631830 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:08.640795 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1430/2859] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:09.134586 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:09.143298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068a1e-aafe-43f7-8116-8ecf59fb8234 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:09.146953 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0a9f-6488-431d-a4b5-12110ae1e02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:09.147599 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0a9f-6488-431d-a4b5-12110ae1e02e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:09.147920 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0a9f-6488-431d-a4b5-12110ae1e02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:09.148203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0a9f-6488-431d-a4b5-12110ae1e02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:09.157414 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0a9f-6488-431d-a4b5-12110ae1e02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:09.158794 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0a9f-6488-431d-a4b5-12110ae1e02e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:09.168299 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1430/2860] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:12.979537 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:13.048405 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcadb5-b332-46be-a351-2b8c30b5cdbd service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:13.055082 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:13.055985 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:13.056273 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:13.056550 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] PATH_INFO: `/v3/users/5e1d2c3075d8422497fa4b3e9f9a5b7c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:13.057745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1d2c3075d8422497fa4b3e9f9a5b7c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:13.059691 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:13.064402 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:13.106269 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1d2c3075d8422497fa4b3e9f9a5b7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.118459 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1d2c3075d8422497fa4b3e9f9a5b7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.119122 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1d2c3075d8422497fa4b3e9f9a5b7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.126094 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1d2c3075d8422497fa4b3e9f9a5b7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.138681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1d2c3075d8422497fa4b3e9f9a5b7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.147646 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1431/2861] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:12 2022] DELETE /identity/v3/users/5e1d2c3075d8422497fa4b3e9f9a5b7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:13.152912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:13.153398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:13.153534 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:13.170777 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:13.171932 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:13.229867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1431/2862] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:24:13.239431 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:13.241533 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:13.297610 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78152eb-c54c-4156-8d1d-060d0dc735aa admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:13.301285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:13.301926 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:13.302218 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:13.302496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:13.312196 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:13.313773 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:13.323064 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1432/2863] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:13.585655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:13.587135 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:13.603067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e3198-20c5-4ddc-909e-26f7db4daa87 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:13.607847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:13.608716 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:13.608994 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:13.609264 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] PATH_INFO: `/v3/projects/70a746b00fb44538b63f5fee53ff1c78` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:13.610570 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a746b00fb44538b63f5fee53ff1c78)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:13.612512 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:13.628689 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:13.661531 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a746b00fb44538b63f5fee53ff1c78', 'request_id': 'req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.667724 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a746b00fb44538b63f5fee53ff1c78', 'request_id': 'req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.674034 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a746b00fb44538b63f5fee53ff1c78', 'request_id': 'req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.686310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] The token cache is being invalidate because project 70a746b00fb44538b63f5fee53ff1c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:13.686601 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.687229 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.688827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1432/2864] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:13 2022] DELETE /identity/v3/projects/70a746b00fb44538b63f5fee53ff1c78 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:13.693069 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:13.702523 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143102df-c060-4832-b5f2-c8eb338f5c6e service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:13.759930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:13.762426 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:13.762713 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:13.763093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] PATH_INFO: `/v3/users/465d449afb054d47b802e8335cd88d6c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:13.764390 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465d449afb054d47b802e8335cd88d6c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:13.766575 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:13.798883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:13.817902 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465d449afb054d47b802e8335cd88d6c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.830356 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465d449afb054d47b802e8335cd88d6c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.831020 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465d449afb054d47b802e8335cd88d6c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.838510 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465d449afb054d47b802e8335cd88d6c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.845681 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465d449afb054d47b802e8335cd88d6c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:13.851682 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1433/2865] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:13 2022] DELETE /identity/v3/users/465d449afb054d47b802e8335cd88d6c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 09:24:14.120207 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:14.121643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:14.135565 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efe2dc-b923-4eb2-a9cb-dc1ac30d73da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:14.193109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:14.194618 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:14.194914 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:14.195190 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] PATH_INFO: `/v3/projects/373d9ba677914f848d4fe3f28e09b39f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:14.196398 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373d9ba677914f848d4fe3f28e09b39f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:14.198329 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:14.242938 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373d9ba677914f848d4fe3f28e09b39f', 'request_id': 'req-02321a98-6f5d-4765-bced-3f77ed679413'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.248490 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373d9ba677914f848d4fe3f28e09b39f', 'request_id': 'req-02321a98-6f5d-4765-bced-3f77ed679413'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.254521 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373d9ba677914f848d4fe3f28e09b39f', 'request_id': 'req-02321a98-6f5d-4765-bced-3f77ed679413'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.267456 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] The token cache is being invalidate because project 373d9ba677914f848d4fe3f28e09b39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:14.267736 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.268405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.269907 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1433/2866] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:14 2022] DELETE /identity/v3/projects/373d9ba677914f848d4fe3f28e09b39f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:14.273844 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:14.275212 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:14.288308 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8ff5-d312-46ba-85ad-1ebbdebe4f68 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:14.346311 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:14.347317 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:14.347602 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:14.347914 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] PATH_INFO: `/v3/users/7c49d247e0484076a52e1e8cfdae79cb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:14.349147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c49d247e0484076a52e1e8cfdae79cb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:14.351140 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:14.399804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c49d247e0484076a52e1e8cfdae79cb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.412407 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c49d247e0484076a52e1e8cfdae79cb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.413123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c49d247e0484076a52e1e8cfdae79cb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.420600 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c49d247e0484076a52e1e8cfdae79cb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.430032 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-19ab8f64-1aab-4c6f-9fe9-761876304c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c49d247e0484076a52e1e8cfdae79cb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.436185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1434/2867] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:14 2022] DELETE /identity/v3/users/7c49d247e0484076a52e1e8cfdae79cb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:14.715240 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:14.716722 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:14.730473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321a98-6f5d-4765-bced-3f77ed679413 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:14.760859 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:14.788482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:14.789378 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:14.789663 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:14.789937 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] PATH_INFO: `/v3/projects/0dce9416276a4790a4105ca553791699` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:14.791147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dce9416276a4790a4105ca553791699)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:14.793181 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:14.838049 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dce9416276a4790a4105ca553791699', 'request_id': 'req-e87f58ee-831b-4866-97cc-a77120a504f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.843377 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dce9416276a4790a4105ca553791699', 'request_id': 'req-e87f58ee-831b-4866-97cc-a77120a504f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.849355 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dce9416276a4790a4105ca553791699', 'request_id': 'req-e87f58ee-831b-4866-97cc-a77120a504f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.861769 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] The token cache is being invalidate because project 0dce9416276a4790a4105ca553791699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:14.862057 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.862685 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e87f58ee-831b-4866-97cc-a77120a504f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:14.864396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1434/2868] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:14 2022] DELETE /identity/v3/projects/0dce9416276a4790a4105ca553791699 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:14.869900 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:14.870194 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:14.870497 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:14.889113 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:14.890300 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:14.909306 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:14.951633 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1435/2869] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:14.960867 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:14.961161 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:14.961463 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:14.980961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:14.982174 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:14.991823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1435/2870] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:14.996026 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.005832 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ef764-0625-431b-91d3-efb96a3406ee None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.010391 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.011043 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.011324 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.011596 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.012363 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:24:15.012664 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.014310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.026293 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1436/2871] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:24:15.030747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.040684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b13e2e-d896-4342-9db7-6b4190cfcffe None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.045383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.046032 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.046317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.046592 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.047276 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.049227 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.074099 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1436/2872] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:24:15 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:24:15.078147 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.088702 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ddeee-3377-4c7a-9071-94d11f04bbd6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.145625 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.146285 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.146565 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.146837 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.148186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.150130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.171125 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1437/2873] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:24:15 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:24:15.175164 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.185497 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f36df-e6c4-4166-91a7-d8c27a9bb7a9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.190179 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.190817 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.191234 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.191520 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.192277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.194060 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.204366 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1437/2874] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:15.208123 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.218512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fbc55-2c51-4ef4-acf6-c77f9a46b9d7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.223130 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a20abc-93f9-4165-8473-a8551b400793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.223798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20abc-93f9-4165-8473-a8551b400793 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.224088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20abc-93f9-4165-8473-a8551b400793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.224362 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20abc-93f9-4165-8473-a8551b400793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.225085 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20abc-93f9-4165-8473-a8551b400793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.227316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20abc-93f9-4165-8473-a8551b400793 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.238798 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1438/2875] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:15.242651 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.252728 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26e064-197f-4300-90f7-89f76f790c9c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.257397 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.258271 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.258554 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.258831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] PATH_INFO: `/v3/projects/032d84dc3b0545ee8950611f7ee9d904/users/795bfd8f703c42569ad719f5f2c98177/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.273719 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032d84dc3b0545ee8950611f7ee9d904, user_id=795bfd8f703c42569ad719f5f2c98177, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.276474 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.290632 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1438/2876] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:24:15 2022] PUT /identity/v3/projects/032d84dc3b0545ee8950611f7ee9d904/users/795bfd8f703c42569ad719f5f2c98177/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:15.300763 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.301262 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.301387 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.326934 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] MFA Rules not processed for user `795bfd8f703c42569ad719f5f2c98177`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:15.328175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:15.389901 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1439/2877] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:15.402509 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:15.404298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:15.467317 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:15.480929 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8e96-5b1f-4b63-91d4-55808f5662a8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:15.485208 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:15.485847 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:15.486132 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:15.486405 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:15.494660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:15.496137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:15.504824 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1439/2878] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 09:24:25.003995 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:25.005419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:25.027930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:25.064291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de504de-0e15-42d6-b771-d480a6c2c736 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:25.067854 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:25.068506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:25.068790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:25.069066 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:25.070952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:25.127819 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:25.129316 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:25.138531 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1440/2879] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:25.501021 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:25.954477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:25.956762 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:26.045452 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7492-9b67-4f17-99bc-94a8e6bde942 service glance] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:26.052383 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120533a970c74d98af45911ba7e6a375', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:26.053231 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:26.053585 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:26.053934 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:26.056831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:26.071059 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:26.072856 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:26.085966 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1440/2880] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:30.861341 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:30.862757 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:30.874114 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f667aa-b43f-4c75-9861-91c51de0a992 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:30.877915 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:30.878606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:30.878951 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:30.879202 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:30.881076 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:30.943641 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:30.945102 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:30.955170 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1441/2881] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:33.742992 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:33.745544 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:33.869053 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721d1fc-a2aa-4f5d-9f52-540a075b5118 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:33.874691 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:33.875481 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:33.875831 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:33.876083 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:33.878346 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:33.892407 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:33.894050 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:33.905353 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1441/2882] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:37.198536 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:37.200371 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:37.212994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ae7f-c4c6-4935-a0b8-94a71adc50f3 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:37.218187 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:37.219070 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:37.219549 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:37.219865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] PATH_INFO: `/v3/users/9baba2d9768f4578aeda5f311964229f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:37.221053 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baba2d9768f4578aeda5f311964229f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:37.222999 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:37.270886 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baba2d9768f4578aeda5f311964229f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.283406 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:37.284698 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baba2d9768f4578aeda5f311964229f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.285419 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baba2d9768f4578aeda5f311964229f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.293443 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baba2d9768f4578aeda5f311964229f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.300429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baba2d9768f4578aeda5f311964229f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.306328 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1442/2883] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:37 2022] DELETE /identity/v3/users/9baba2d9768f4578aeda5f311964229f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:37.475110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:37.487365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b0a9c-9ba2-4192-a779-5b0f058d0898 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:37.544862 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:37.545727 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:37.546010 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:37.546286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] PATH_INFO: `/v3/projects/39196d3b3d514f458e0657ccafaf4134` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:37.547457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39196d3b3d514f458e0657ccafaf4134)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:37.549449 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:37.565713 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:37.596042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39196d3b3d514f458e0657ccafaf4134', 'request_id': 'req-539b112f-f76c-4cde-aabb-e1e020db7b26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.601633 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39196d3b3d514f458e0657ccafaf4134', 'request_id': 'req-539b112f-f76c-4cde-aabb-e1e020db7b26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.608457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39196d3b3d514f458e0657ccafaf4134', 'request_id': 'req-539b112f-f76c-4cde-aabb-e1e020db7b26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.621747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] The token cache is being invalidate because project 39196d3b3d514f458e0657ccafaf4134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:37.622095 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.622825 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.624608 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1442/2884] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:37 2022] DELETE /identity/v3/projects/39196d3b3d514f458e0657ccafaf4134 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:37.628606 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:37.630121 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:37.643452 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486a126-adb4-4792-b459-41621745fa2f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:37.700332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:37.701201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:37.701482 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:37.701753 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] PATH_INFO: `/v3/users/ba728fee7fa641dbb716072142ffdb45` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:37.702916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba728fee7fa641dbb716072142ffdb45)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:37.704865 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:37.749988 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba728fee7fa641dbb716072142ffdb45'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.761917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba728fee7fa641dbb716072142ffdb45'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.762566 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba728fee7fa641dbb716072142ffdb45'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.769291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba728fee7fa641dbb716072142ffdb45'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.776164 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba728fee7fa641dbb716072142ffdb45'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:37.782261 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1443/2885] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:37 2022] DELETE /identity/v3/users/ba728fee7fa641dbb716072142ffdb45 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:37.956483 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:37.957935 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:37.977357 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b112f-f76c-4cde-aabb-e1e020db7b26 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:38.034283 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:38.035090 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:38.035370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:38.035643 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] PATH_INFO: `/v3/projects/f12c1963d8fe4970b22c85395be5ca54` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:38.036845 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12c1963d8fe4970b22c85395be5ca54)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:38.038776 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:38.083903 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12c1963d8fe4970b22c85395be5ca54', 'request_id': 'req-79c103a2-43c0-4097-8b62-f984d936955e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:38.089291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12c1963d8fe4970b22c85395be5ca54', 'request_id': 'req-79c103a2-43c0-4097-8b62-f984d936955e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:38.095251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12c1963d8fe4970b22c85395be5ca54', 'request_id': 'req-79c103a2-43c0-4097-8b62-f984d936955e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:38.106933 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] The token cache is being invalidate because project f12c1963d8fe4970b22c85395be5ca54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:38.107213 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:38.107855 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-79c103a2-43c0-4097-8b62-f984d936955e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:38.109365 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1443/2886] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:37 2022] DELETE /identity/v3/projects/f12c1963d8fe4970b22c85395be5ca54 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:47.778882 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=60,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:48.104041 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:57.103039 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:57.104468 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:57.117018 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f8d3a-7f0f-4fef-85f9-7e1434fd8182 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:57.172310 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:57.173186 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.173469 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.173745 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] PATH_INFO: `/v3/users/795bfd8f703c42569ad719f5f2c98177` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.174916 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795bfd8f703c42569ad719f5f2c98177)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:57.176911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:57.223342 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795bfd8f703c42569ad719f5f2c98177'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.235185 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795bfd8f703c42569ad719f5f2c98177'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.235931 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795bfd8f703c42569ad719f5f2c98177'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.242792 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795bfd8f703c42569ad719f5f2c98177'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.250148 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795bfd8f703c42569ad719f5f2c98177'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.256005 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1444/2887] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:24:57 2022] DELETE /identity/v3/users/795bfd8f703c42569ad719f5f2c98177 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:57.260478 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.260984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.261110 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.279206 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:57.280441 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:57.338308 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1444/2888] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:24:57.347883 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:57.349288 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:57.405598 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d719c-d045-450a-bef0-d2d8930ac101 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:57.409286 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb414f-8037-4a80-8ad8-a7b572d1a433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:57.409930 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb414f-8037-4a80-8ad8-a7b572d1a433 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.410216 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb414f-8037-4a80-8ad8-a7b572d1a433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.410496 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb414f-8037-4a80-8ad8-a7b572d1a433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.419434 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb414f-8037-4a80-8ad8-a7b572d1a433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:57.420917 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb414f-8037-4a80-8ad8-a7b572d1a433 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:57.430233 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1445/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:24:57.694298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:57.695748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:57.707741 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60c1ce-332e-4b47-8af7-f860fb8eb733 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:57.712323 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:57.713203 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.713470 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.713742 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] PATH_INFO: `/v3/projects/032d84dc3b0545ee8950611f7ee9d904` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.714942 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032d84dc3b0545ee8950611f7ee9d904)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:57.716955 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:57.765627 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032d84dc3b0545ee8950611f7ee9d904', 'request_id': 'req-25307a18-f6c5-4438-b3e2-5b12e1513266'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.771137 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032d84dc3b0545ee8950611f7ee9d904', 'request_id': 'req-25307a18-f6c5-4438-b3e2-5b12e1513266'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.777480 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032d84dc3b0545ee8950611f7ee9d904', 'request_id': 'req-25307a18-f6c5-4438-b3e2-5b12e1513266'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.789877 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] The token cache is being invalidate because project 032d84dc3b0545ee8950611f7ee9d904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:24:57.790172 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.790814 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25307a18-f6c5-4438-b3e2-5b12e1513266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:24:57.792394 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1445/2890] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:24:57 2022] DELETE /identity/v3/projects/032d84dc3b0545ee8950611f7ee9d904 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:57.797721 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.798015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.798291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.816490 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:57.817737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:57.834706 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:57.880109 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1446/2891] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:57.887660 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.888037 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.888314 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.906214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:57.907395 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:57.915073 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1446/2892] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:57.919438 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:57.928776 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a06f7-6891-4992-8f55-c3a3d6128837 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:57.933211 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:57.934472 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.934751 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.935030 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.935774 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:24:57.936093 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:57.937699 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:57.948880 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1447/2893] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 09:24:57.952802 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:57.962038 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b95d61-8dac-471c-8661-afa4afa2aa3c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:57.967477 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:57.968196 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:57.968484 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:57.968761 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:57.969455 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:57.971382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:57.998315 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1447/2894] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:24:57 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:24:58.002417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:58.012365 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9b7db-3fda-4b7c-a244-029784430e30 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:58.070790 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:58.071458 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:58.071737 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:58.072038 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:58.072707 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:58.074663 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:58.094250 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1448/2895] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:24:58 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 09:24:58.099427 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:58.110286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90695d86-da1a-4757-8f88-9efc75303699 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:58.114912 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:58.115566 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:58.115890 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:58.116170 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:58.116886 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:58.118491 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:58.128671 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1448/2896] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:58.132437 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:58.142456 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b89b67-b835-4f4f-8663-7437f2e709b0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:58.147135 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20c6f-4278-4561-8505-23f1283687e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:58.147857 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20c6f-4278-4561-8505-23f1283687e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:58.148143 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20c6f-4278-4561-8505-23f1283687e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:58.148417 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20c6f-4278-4561-8505-23f1283687e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:58.149138 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d20c6f-4278-4561-8505-23f1283687e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:58.150739 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d20c6f-4278-4561-8505-23f1283687e4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:58.161349 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1449/2897] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:24:58.165286 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:58.175669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3f97-bc72-4c30-bc03-ba17cba11d7f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:58.180239 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:58.181106 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:58.181382 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:58.181650 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] PATH_INFO: `/v3/projects/b3f68d7ea4b4479b840ecd5505169f3c/users/416777de02e9450f877ce1721c27d38b/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:58.195748 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f68d7ea4b4479b840ecd5505169f3c, user_id=416777de02e9450f877ce1721c27d38b, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:58.198431 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:58.210917 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1449/2898] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:24:58 2022] PUT /identity/v3/projects/b3f68d7ea4b4479b840ecd5505169f3c/users/416777de02e9450f877ce1721c27d38b/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:24:58.221168 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:58.221462 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:58.221741 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:58.248528 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] MFA Rules not processed for user `416777de02e9450f877ce1721c27d38b`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:24:58.249726 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:58.312291 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1450/2899] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:24:58.323370 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:24:58.325591 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:24:58.350887 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:24:58.388056 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f60aa8-d6b3-4aa7-8ab6-d739f1cb792b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:24:58.391705 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5128-f49d-4809-a8e1-7f649be6cbd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f623ab113a43b791f0180286fa5ac3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:24:58.392384 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5128-f49d-4809-a8e1-7f649be6cbd4 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:24:58.392669 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5128-f49d-4809-a8e1-7f649be6cbd4 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:24:58.392947 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5128-f49d-4809-a8e1-7f649be6cbd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:24:58.401363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a5128-f49d-4809-a8e1-7f649be6cbd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:24:58.403781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a5128-f49d-4809-a8e1-7f649be6cbd4 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:24:58.412606 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1450/2900] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:24:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:25:08.309397 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:25:08.408621 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=17 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:25:29.180949 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:29.241952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a9523-4516-4eb4-816d-36f6d7843f81 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:29.246355 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:29.247222 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:29.247506 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:29.247804 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] PATH_INFO: `/v3/users/416777de02e9450f877ce1721c27d38b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:29.249578 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416777de02e9450f877ce1721c27d38b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:29.251516 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:29.298301 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416777de02e9450f877ce1721c27d38b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.310029 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416777de02e9450f877ce1721c27d38b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.311366 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416777de02e9450f877ce1721c27d38b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.318229 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416777de02e9450f877ce1721c27d38b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.325512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416777de02e9450f877ce1721c27d38b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.331483 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1451/2901] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:25:29 2022] DELETE /identity/v3/users/416777de02e9450f877ce1721c27d38b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:25:29.336143 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:29.336668 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:29.336773 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:29.353827 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:25:29.355016 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:29.413042 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1451/2902] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:25:29.423106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:29.424512 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:29.480400 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b46c1-1f12-4fa1-a18a-d1f9b4831bd5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:29.485448 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f74b3c-1945-4558-8d5b-3fc450b9e4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:29.486100 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74b3c-1945-4558-8d5b-3fc450b9e4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:29.486392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74b3c-1945-4558-8d5b-3fc450b9e4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:29.486671 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74b3c-1945-4558-8d5b-3fc450b9e4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:29.495881 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f74b3c-1945-4558-8d5b-3fc450b9e4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:29.497264 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f74b3c-1945-4558-8d5b-3fc450b9e4b8 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:29.506616 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1452/2903] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:25:29.771396 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:29.772930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:29.787338 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59cf52-8ea1-4d14-8bb6-b18ba9746812 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:29.792235 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:29.793220 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:29.793639 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:29.793789 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] PATH_INFO: `/v3/projects/b3f68d7ea4b4479b840ecd5505169f3c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:29.795729 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f68d7ea4b4479b840ecd5505169f3c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:29.797655 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:29.844067 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f68d7ea4b4479b840ecd5505169f3c', 'request_id': 'req-7f32e461-521e-430f-b17d-b7054f546538'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.849631 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f68d7ea4b4479b840ecd5505169f3c', 'request_id': 'req-7f32e461-521e-430f-b17d-b7054f546538'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.856281 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f68d7ea4b4479b840ecd5505169f3c', 'request_id': 'req-7f32e461-521e-430f-b17d-b7054f546538'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.868815 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] The token cache is being invalidate because project b3f68d7ea4b4479b840ecd5505169f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:25:29.869103 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.869714 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f32e461-521e-430f-b17d-b7054f546538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:29.871233 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1452/2904] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:25:29 2022] DELETE /identity/v3/projects/b3f68d7ea4b4479b840ecd5505169f3c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:25:29.876871 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:29.877162 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:29.877441 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:29.895812 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:25:29.897015 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:29.913727 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:25:29.958106 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1453/2905] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:25:29.965930 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:29.966221 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:29.966504 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:29.986130 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:25:29.987335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:29.995249 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1453/2906] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 09:25:30.000007 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.009771 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045e92-df5a-42d5-adca-c92fbbbc07bc None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.014420 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.015011 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.015290 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.015559 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.016319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 09:25:30.016622 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.018215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.029758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1454/2907] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 09:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 09:25:30.033747 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.042986 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286345-3d31-4c44-9aa7-6bd263d74b7a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.048291 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.048967 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.049251 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.049524 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.050212 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.052145 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.079028 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1454/2908] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 09:25:30 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:25:30.082796 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.093274 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11706-9320-48d3-ae69-276e6d8eeebd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.147997 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.148661 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.148942 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.149215 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.149895 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.152117 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.172614 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1455/2909] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 09:25:30 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 09:25:30.176710 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.186995 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7674fdb-2c5c-4e48-b35c-87699cf980cc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.191559 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.192244 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.192526 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.192799 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.193543 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.195147 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.205337 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1455/2910] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:25:30.208945 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.219319 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92de6a4-4b50-40b8-b44f-0552e99e5ba6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.224016 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee4a0-85ab-48d5-b293-e44e637b439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.224668 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee4a0-85ab-48d5-b293-e44e637b439e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.224956 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee4a0-85ab-48d5-b293-e44e637b439e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.225236 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee4a0-85ab-48d5-b293-e44e637b439e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.225952 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee4a0-85ab-48d5-b293-e44e637b439e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.227551 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee4a0-85ab-48d5-b293-e44e637b439e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.238107 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1456/2911] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 09:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 09:25:30.241901 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.251781 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d94f0b-25b9-42e1-9363-76e940062a7f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.256363 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.257228 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.257510 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.257786 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] PATH_INFO: `/v3/projects/145e815be2f3466e9bd210892b7684e1/users/48e097487a934cefa902fdaec62c5862/roles/2dc775396d5544848b5553a1e7bf708b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.272065 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=145e815be2f3466e9bd210892b7684e1, user_id=48e097487a934cefa902fdaec62c5862, role_id=2dc775396d5544848b5553a1e7bf708b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.274684 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.288277 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1456/2912] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 09:25:30 2022] PUT /identity/v3/projects/145e815be2f3466e9bd210892b7684e1/users/48e097487a934cefa902fdaec62c5862/roles/2dc775396d5544848b5553a1e7bf708b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:25:30.299530 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.299911 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.300195 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.327298 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] MFA Rules not processed for user `48e097487a934cefa902fdaec62c5862`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:25:30.328534 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:30.390758 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1457/2913] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:25:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:25:30.401223 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:30.403241 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:30.426017 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:25:30.462604 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8824-6e54-42f0-9278-5bbe6c5ad47f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:30.466214 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49a9cf-abe2-49c6-8432-6586eadc0133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06192133f444b13933b7c4a1997e3cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:30.467335 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a9cf-abe2-49c6-8432-6586eadc0133 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:30.467611 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a9cf-abe2-49c6-8432-6586eadc0133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:30.467909 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a9cf-abe2-49c6-8432-6586eadc0133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:30.476030 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49a9cf-abe2-49c6-8432-6586eadc0133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:30.477453 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49a9cf-abe2-49c6-8432-6586eadc0133 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:30.486961 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1457/2914] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:25:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:25:40.387815 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:25:40.482215 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=17 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:25:51.722213 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:51.784175 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e6287-e5fd-40f8-af14-50f8b5c3c880 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:51.788736 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:51.789605 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:51.789889 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:51.790165 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] PATH_INFO: `/v3/users/48e097487a934cefa902fdaec62c5862` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:51.791429 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e097487a934cefa902fdaec62c5862)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:51.793488 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:51.841331 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e097487a934cefa902fdaec62c5862'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:51.853383 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e097487a934cefa902fdaec62c5862'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:51.854031 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e097487a934cefa902fdaec62c5862'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:51.861392 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e097487a934cefa902fdaec62c5862'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:51.868662 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e097487a934cefa902fdaec62c5862'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:51.874928 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1458/2915] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 09:25:51 2022] DELETE /identity/v3/users/48e097487a934cefa902fdaec62c5862 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:25:51.879472 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:51.879984 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:51.880120 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:51.897109 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] MFA Rules not processed for user `85bd9af08cec4721bdd226bdaa9b2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 09:25:51.898298 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:51.955918 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1458/2916] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 09:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 09:25:51.965584 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:51.967071 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:52.024142 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a02dd1-e350-4a81-84cf-d527f6caa23e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:52.028097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98347f8bc43f46b0aa0d6fb38c162885', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:52.028738 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:52.029021 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:52.029297 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:52.038718 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:52.040220 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:52.050201 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1459/2917] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:25:52.312949 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:25:52.314473 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:25:52.326180 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ca4c-43b1-425e-a2f3-9a9d905ae9bd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:25:52.330823 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bd9af08cec4721bdd226bdaa9b2d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8d8a528e88945da98e9389d0fe7141f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:25:52.331692 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:25:52.332007 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:25:52.332279 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] PATH_INFO: `/v3/projects/145e815be2f3466e9bd210892b7684e1` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:25:52.333457 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145e815be2f3466e9bd210892b7684e1)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:25:52.335482 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:25:52.384488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145e815be2f3466e9bd210892b7684e1', 'request_id': 'req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:52.390458 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145e815be2f3466e9bd210892b7684e1', 'request_id': 'req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:52.396738 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145e815be2f3466e9bd210892b7684e1', 'request_id': 'req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:52.410000 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] The token cache is being invalidate because project 145e815be2f3466e9bd210892b7684e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 09:25:52.410310 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:52.410924 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6cf598c7-64b3-4f96-9abc-e6adcd5526c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 09:25:52.412488 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1459/2918] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 09:25:52 2022] DELETE /identity/v3/projects/145e815be2f3466e9bd210892b7684e1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 09:26:02.045408 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:26:02.406403 dv-cinder-812685-8-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:27:55.704651 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 09:27:55.706037 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:27:55.844908 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40b23-c423-440e-b476-4746297d1012 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 09:27:55.902994 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c78bee52575447ca8f4e1bf2c7a3c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ad54bc08bf24aa98879d84c5baf0904', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 09:27:55.903640 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 09:27:55.904055 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 09:27:55.904332 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 09:27:55.906088 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 09:27:55.917097 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 09:27:55.918701 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4ed5-01cd-46dd-8bfb-f1570492a5b4 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 09:27:55.929842 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1460/2919] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 09:27:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 09:28:05.924454 dv-cinder-812685-8-iscsi devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}